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' California's program review process has been designed 
to judge the effects of th£ school program on students and staff and 
to identify opportunities for improving the program. The majority of 
program reviews 'are conducted by representatives of the State 
Department of Education and by consortia of schoo} districts. These 
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chfpters. Chapter 1 describes the program re^±j£process; chapter 2 
tells how to conduct a" review and includes theyjTyiteria used to judge 
and improve the effectiveness of the prog*am;/aiid .chapter 3 describes 
how the report, of review findings is developed and shared with the 
school staff, parents, and community members.- (Author/MLF) ^ 
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The Program Review Handbook* for * 1981-8? t while 
essentially the same as the handbooks of previous 
years, contains seme m modification*. Reviewers 
familiar with previous handbooks will find that 
Chapter II has been reorganized into a more useable 
format. 

In addition, there have 'been some modifications 
of the quality criteria* « 

In the section titfed "The Effect of Instruc- 
tion on the Student" tbe reviewer will find three 
new or substantially modified criteria; they are: 

- The Effect of Bilingual Services on Limited- 
TZnglish-Prof icieat Students. 
. This criterion has been revised to reflect 
the requirements of the Bilingual Education 
Improvement and Refon* Act of 1980 (AB 5Q7); 
It Is to be used in Elemeatafy and Secondary 
schools providing s$rvic£s to LEP students 
through (a), (b), (c), (d), (^), and (f) 
programs which have 21 or more LEP students. 

4 - The Effect of Instruction and Services for 
Students with Exceptional Needs. 
JMs criterion is a revision of the criteria 
r that were piloted during the 1980-81 review 
seafon. It is to be used in schools when 
special education services are being provided 
within the regular instructional program as 
well as through special day classes. 

'< 
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- The Effect of the Total Program on' Students. 

This is a new criterion. It examines the 
r impact of the total instructional program on 
. the^student and special -services received by 9 

the student • 

In the sect-An titled "The Improvement Process" 
two previdu* criteria - The Effect of Translating 
the Plan into Action and The Effect of Planning and 
Evaluation have been fc combined into one eriterlon 
titled "The Effect of Planning, Translating and 
Evaluation" • , 

This hanflbedk has been designed to guide « 
persons who serve aa members Of a program review 
team — parents or staff who participate in internal 
or self-reviews or* pg^ons from outside the district 
serving . as part ~ of^ti external review team. The 
program % review process , has been designed for judging 
the effects of the school program on students and 
staff and to fdefiFlfy opportunities for improving 
the program.. m t * 

Although many school districts use reviews aa a 
means of assisting their schools In program develop- 
ment / t,he majority of program reviews are conducted 
by representatives of the St*te Department of* 
Education and by consortia of school districts. 
These program reviewers will use the procedures, the 
criteria for judging program ef fectivmness, ^nd the 
opportunities for improving contained within this 
handbook. 
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Conducted- concurrently with the quality review 
is a review of the compliance of the school program 
to the requirements of law and regulation 
that accompany the special f6nds received by the 
school. To ascertain program compliance, program 
reviewers will use the' instructions aqd criteria 
contained in the Guide for Reviewing School- 
Program Compliance > 1981-82 , 
i 

Both state and federal laws mandate the 
periodic review of schools receiving special funding 
through the consolidated application. The program 
review process has been implemented in. schools 
receiving School Improvement funding; Economic 
Impact Aid for compensatory education (state funds); 



and Elementary agd Secondary Education Act, Title 1, 
(federal funds) for educationally disadvantaged 
student 8. It is hoped, however^ that all schools, 
regardless of funding, ttill find program geview 
beneficial in their efforts to provide high quality 
education. 

The handbook is divided into three chapters: 
Chapter I describes the program review process, 
J Chapter II tells pov to conduct a i review and 
includes the criteria' used to judge and improve the 
effectiveness of the program, and Chapter* I£I 
describes how the report of review findings is 
developed and shared with the school staff, parents, 
and community members. "? 
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CHAPTER I 



A, DEFINING A PROGRAM REVIEW 

The Purpose of Program Review . 

) Pro gran review is a process used to evaluate the 
quality of a school program and to identify ways in 
which the program can be improved. Program reviews may 
be conducted by State Department of Education, county or 
district personnel who, although external to the school, 
abate accountability with the person%L at the school 
for the quality of the instruction provided for 
students^ The review process may be used by the school 
staff. 

The primary purpose of program revieV, whether an 
external or internal review, is to improve the* school 
program, - It is a means for developing and sustaining a* 
high quality educational program fofc each student. 

* .» 

The Scope of Program Review 

The program review process ^escribed in this hand- 
book is based on a particular perspective toward the 
school* prog r a*. This perspective places the focus on 

< students' and examines the effect the instruction 
received by tlje student actually has upon the student, 
fhe effect the support fo/r 'the instructional program has . 
. upon instruction and the student, and the effect' the 
program improvement process has upon bot£ instruct ional 
support and instruction. The relationship among these 
aspects of the school, program is shown in Figure !.. 
Notice that the student is at the center and is the 
intended recipient, directly or indirectly, of the 
effect of the other aspects of the school }>rogram*which ' 
are depicted as concentric rings around the student. 

. • • \ 
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Instruction 

% 

For review purposes, instruction is defined in two 
ways. First, it is that instruction actually received 
by the student in contrast to the instruction of feted by 
the school or^ in, other words, the instruction actually 
experienced by the student versus instruction launched 
toward him or her by the staff. Secondly, instruction 
\s broadly applied and includes all the learning 
experiences of students during the school day as well aa 
during extracurricular activities under the control of 
the school. 

Support r 

r 

The next ring .includes two kinds of activities:* 
Those planned as support to instruction, such as staff 
development and parent involvement, and those services 
that directly support students, such as guidance and" 
health services. 
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The Improvement Process ' % 

The ^outermost ring of activities,, the improvement 
process, includes the council/committees which have 
responsibilities for planning the program and all of the 
informal as well as formal processes* ijsed -in developing 
the planned program. These include both _,yeafrly and 
ongoing plahning and, evaluation activities as* well as 
activities which translate the planned program -into 
aqtlon. " \ 

]jhe Review Strategy 

•The, r*j£lew strategy is .based 6n the perspective 
'toward .the sfchbdl program just described. The review 
sti&rt^ 14th tjtie* student and ^orka out toward instruc- 
tion^" support, and how\the /planned /program is being 
translated ; ^itto artiotf, : • Ttaifc direction — from the 
student outward—is, complemented by a review of the 
planned program ;which looks' at how ,th£ plan was or was 
not trapslated^into acttoh'artd at r tti& effect ,of plan- 



ing, t tans la t ion"]! evaluation, and.^uppott activities on 
instruction. Thus^'the review ~teara will go back and 
forth jj g feWhigh ^ht rings or layers of the school program 



to <fete™WjT the effect of one part of' the program on 
another and ,analyzing^ hpw the effects might be improved 
or maintained,* pursuing key linkages where activities 
have been particularly effective or whertf? improvements 
might have particularly hjph^ payoffs. The links 
emphasised are; ' 

w •The li*k between the: instrupfcion received by the 
student and" what adulU dp to mpke th'iq instruc- 
tion happen for the student and . , 

\ • 

• TKe Glinka between the plaftrfed program and trans- 
lation activities arid between the translation 
activities and the implemented program f 



f The strategy used by thy -reviewers i« to develop a # 
1 picture of how things wodp fqr the students at the> 
-school. This picture is developed -primarily from si\ 
observation # of Individual student?, analysis of the ' 
student 1 s . current work (connecting the current woflc to » 
/past work), instructional staff and atudent explanations 
of student's Current and pas* activities, and ins true- 
. tibrlal and management material used by the staff. These., 
observations are -supplemented by discussions With staff • 
and parenta. This picture "iprms the basis for the 
reviewers 4 *. /judgment of the effect of instruction on the 
• s'tudent . \ * 

After the reviewers have! 9 picture bf what is 
happening for the students, tney focus on fin ding but 
, % what processes at the sehofcll .contributed to what is 
happening. The reviewers ' seek? explanations from staff 
of why they do things th£ way they do, where the 
^instructional program comes from, how it is supported 
\md improved,, how plans get JttAnslated into action, and 
so on. Theifocus, is on effects rather thait on, process 
' for proces^e^ sake. ThiVjjicture forma the basis for 
the reviewers 1 ' sugges tion^Tlifcarding * opportunities for 
imprbving thje effect of inslfraction on 'students. 



^ As the reviewer completes, the review of x the pro- 
gram, a report of findings is prepared (see Chapter 
III). The report, which is based pn the perspective 
toward a 'school program described earlier , provides for 
two types pf findings > (1) the judgment of quality* of * 
the effect of,*each aspect of the program, under review; 
and (Z)} suggested opport^uniti^p for improving or 
sustaining the effectiveness of the program. ^ , ^ 
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By using* these opportunities for ^nprqvlng, the reviewer 
identifies prime improvement areas and indicates how the 
Improvement process at the school can be activated to 
Improve ^or sustain the quality of the program 'In the 
areas Identified * 

The Relationship Between Program Review 
and Ongoing Planning and Evaluation 

« The program review process described In this hand- 
book Is designed to complement, .not replace, the exist- 
ing 'ongoing planning snd^ eyaluation processes at a 
school. Reviewers should make extensive use of Infor- 
mation developed wi thin ; the school's Ongoing planning 
and evaluation fjocedures. Together, program review and 
planning and evaluation procedures can form a maj^r phrt 
of the total evaluation process at a school. 

Reviews conducted 'fey tevietfere from outside the 
school provide a fresh viewpoint and* Independent vali- 
dation of Internal review findings. The program review 
conducted for the Sffate 'Department of Education, either 
by a state review team or through a consortium of dis- 
tricts, will be baaed, oij this handbook. In contrast to 
the two or three days available for external reviews, a 
school can use all or part of these procedures over a 
'longer period of time. Such use of these procedures by 
the people at ^^school prior to* an external review can 
do much to Improve the validity of the external review. 

Familiarity with the review criteria and procedures 
will help staff and parent communicate effectively with 
reviewers, and they w^l help reviewers obtain the 
information they need to make Informed judgments. 

f , 
~ The findings of program review, whether Internal or, 

external, can be of assistance In discussions and 

decision making about designing and implementing staff 
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development act lyl ties, In determining where assistance 
is needed, and In determining where changes are needed 
In the way the planned * program Is translated into 
action. lt\ short, the program review process, yields 
^information that is essential to effective program 
development — Information* about what is working well and 
why and what should be changed and how. Program review 
can be a valuable part "In the program improvement cycle 
of planning, translating the planned program Into 
action, evaluating the Implemented 'program, and 
modifying the planned program. 

' • % v 

Program Review Responsibilities ^ 

For the purpose of pTograa review to be achieved, 
reviewers and school personnel alike 'must recognise and 6 
accept their responsibilities for ensuring that the 
review process is a means for developing and sustaining 
a high quality educational program for each student at 
the^ school . 

» * *• < 
Major Responsibilities of the Reviewers . 

The major responsibilities of the reviewers are: 

* To' conduct the review thoroughly, enough for the * 
development of a cleir and accurate understanding 
of the effectiveness of the school program. 

e To use that knowledge to make usable suggestions , 
for increasing or sustaining the effectiveness 
of the program. % * 

In fulfilling these responsibilities, each reviewer 
must: , * 

e Prior to entering into the review process, put 
aside any preconceptions of what the program 
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should be' like as. well as ,any personal ; educa- 
tional, or managerial preferences. 

* * * 

• Use the self-review findings to facilitate 
dispussions with school staff and parents. 
These discussiorfe "should cover the sdhool* pro- 
gram, and hdw well it is working and provide 
evidence sufficient to verify, extend, clarify, 
enricjh, or repudiate -those finding*. 

4 

* Be able to reflect back to the school — as a 
mirror — the picture* he or she has developed 
of the effectiveness of the school program. 

Be able ta^link the knote^dge of what the pro- 
n gram is witty what the school community intends 

it to be in 'such a way that the school 
community can use ths program review experience 
as a springboard for concerted improvement 
activities. 

a Recognise and support the program improvement 

efforts of the school community*. 

• * * « 

Major Resets Ibi titles of the School Community - 

The major responsibilities of the staff, parents 
and community members involved in a program reviey are: 




• To know th^j^vinned program 'and how wtfll it is 
working fortm^tudents. This requires know- 
ledge of the planned program as a whole . 

• Tb know what he or she is doing in relation to 
the planned proframr , 

• To be ready to share this knowledge with the 
review team and to |>e able to direct reviewers 

* to the information they heed to fulf ill their 
responsibilities. 



program, 
f 



• To be familiar with the program review process 
And criteria described in this handbook*, 

• To be involved as a total staff in identify- 
ing program strengths and weaknesses, in relation 
to program review "Opportunities for Improving** 
and. the corresponding 'criteria. This requires 
spelling out activities which are working well \ 
as well as areas where improvements are needed.' 

I i - 

• To^be able, to describe to Ahe. review team how 
the school's self review results fit into the 
ongoing planning and evaluation process. 

In essence, the role ofJ school peraonnel Is one 
that is created through shared understanding of the 
review process and how tha£ process interfaces with 
implementation of their- planned 

How the School Community Prepares for a Program -Review 

While the review jteam is jresponsible for learning 
as much about the jjrogrim as <ian be learned in a limited 
period of time, the school community is responsible for 
making sure that, the team is given accurate and complete 
information about the program. Therefore, .a school 
community prepares for program. Ireview--whether internal 
or external — through * ongoing [planning ' and evaluation 
activities that enable the members to know how well 
their program's -Working and why. With^this knowledge, 
the 9CI190I community will 'be able to aasit the reviewers 
in gathering accurate information about ' the program; 
further, the findings of the review — especially the 
opportunities for Improving — will be more helpful to the 
school community. , 

*-. 

Schools to receive a program review should be fami- 
liar with both the prd^edurea and the criteria for ^udyr 
ing quality contained thi* handbook. Although achools 

17 
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• may adopt these procedures and criteria to better suit 
. their needs in evaluating the effectiveness of their pro- 
gran, reviewers will apply th£ procedures and criteria 
contained in the handbook. While the review process 
described in this handbook covers the total, planned 
program at the school, school personnel planning for 
program improvement may find it beneficial to review part 
of their program at a time, covering the entire pr^Rram 
over a period of months rather than trying to review that 
entire program at one time. 

. ) The procedures outlined in this handbook can be 
applied in a number of Ways. For example, by: 

* • Each classroom teacher and aide judging the effect 
of their instructional program; using the program 
review criteria, \ and identifying opportunities for 
improvement. 

• Each classroom teacher trading classrooms with 
another teacher ,to observe "how" and "what" 
students are learning and Judging the effect of 
instruction on students. 

• Teachers at each grade level or grade span selecting 
a teacher or a few f teachers to apply the* instruc- 
tion and instructional support criteria in each 
classroom. . \ • v 



The School Site' Council , School Advisory Council, 
Bilingual Advisory Committee selecting members to 
form a review team to review the total program, 
ua^ng the criteria for judging the effectiveness 
of, instruction, support, and the improvement 
process. J 



The process of the self-review should not be focused 
on tha "rating," but on how the program is affecting 
students, thst is, what .has been learned during the 
review. lA order that what has been learned during the 
8elf-revieJL>can be known by the staff and others at the 

r-: 
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school, shared with the external review ttfam, used for 
making decisions about program improvement activities 
and confirmation of program effectiveness, that which 
was learned must be communicated to the entire school 
community, ^ ; f 

B. THE PROCESS OF * PROGRAM REVIEW 

+~ 

This section describes how a program review is 
conducted. While the descriptions and. instructions are 
directed primarily toward reviewers who are external to 
the school, the school should adapt, as appropriate, 
parts of this ^process for use in .self-review of the 
quality of the school program. 

Preparing for the Program Review * 

Careful preparation for the program rlvieW fs 
essential if the program review is to achieve its 
purpose for tt\e school. 

Reading the School Plan v 

• f * 
The school plan is the first contact the reviewer has 

with the program at the school • Prior to the school 

visit , the reviewer will read the school plan 

thoroughly, probably several times, - to ensure 

understanding of the planned program. * 

After reading the plan, the reviewer should ^cffow: 

• The special funding received by the school and 
related program requirements' 

• The nature of the student population % 

• The program areas that will be reviewed 

t 

* \ * 

• The goals of the program and expectations for 
student and adult performance (objectivea) 
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• What should be obsj^vable, (activities) 

• Relationships among needs, objectives, ancT activities 

• Processes defined in the school plan (planning and 
evaluation activities monitoring of program imple- 
mentation, articulation*, and/or coordination activi- 
ties designed to bring together 'the various services 
provided for students) 

• investigation strategies which the reviewer will 
use, to find or validate those processes which are not 
clearly Refined * - \ ' S 

The reviewer must have a good' graap of the planned 
program as represented in the school plan in order to 
understand the' program provided for students at the 
school and how the people at t\\e school plan to make the 
prog tarn work. 



Contacting the School ■ 

Approximately four weeks before the school visit, 
the review team leader will telephone thfe principal to: 

Clarify any questions about the program stemming from 
the review of the school plan • - 

• Identify any nfajor changes in the plan or budget 

• Identify areas of the school program to be* covered 



in 



the review % / ? 



,* Identify all special services currently offered at 
school site 



• Disrubs the nature 6f- the school community 

• Clarify' an£ concernV"Df^questions/ thct school, principal 
and,, 8bff f may have m 

' * " /■ 

• Establish th* review schedule , " 

* « « * • 

i Identify the documents that the team will nee4 to 
review s 

« Discuss the review procedures to be ysed by the school 

• in preparing for the review 

✓ Meeting of the Review Team ' - 

\ ' 

The team reviewers Should plan to meet for at least 
two hours on the, night befote the visit to the school 

, to : 

• Share information gained from the team leader's tele- 
phone call tb the principal 

f . 

• Discuss the school plan ^ * % 

• Plan strategies for the review^ . 

• Define reviewer roles artd responsibilities 

• Designate meeting times during'the review to "touch < 
K -base" and share perceptions 

% Review the review schedule - \ * 

• Get to ltnow each other's interests and strengtHs 

' 21 
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Conducting the Review * 

In finding out about the quality of the school 
program, three basic review o^thods are used by the 
revisers to learn . what the program is and how It Is 
working. They are: (1) classroom observation; (2) in- 
terviews—both formal afa' informal, and (3) the review 
of records and documents. "Each of these methods Is used 
in conjunction with the others . for example, while 
observing in a classroom Che reviewer will learn what 
currently is happening. By looking at a students work 
of a few days ago and records of student's progress over 
a fiw months, the reviewer then develops a sense of how 
appropriate and how typical the observed activities are. 
Similarity, by talking with the teacher and students 
about the observed activities, the reviewer, can verify 
the accuracy and completeness of his or her observations. 
Information gathered through each method is verified by 
inf^mation from one or both of the others. 

In addition', each review Includes events or review 
procedures which are a standard part of every program 
review. These events- or procedures provide a framework 
in *hicjy"<he reviewers jpply the review methods of 
classrood <|>servation, interviews, and review of records 
and documents. v Adherence to those procedures h>lps 
ensure, both for the school and the reviewers, .that \he* 
review wUl> be thorough and consistent with all other 
program rfeviev*. 



Classroom Observation 

Through classroom observation, the reviewer gathers 
, # basic information about the school program in order to 
Judge .the effect of the instructional program on how and 
what students are learning, the effect of staft develop- 
ment activities on those working with the students, the 
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effect of other instructional support activities, and 
the effect of activities to translate the planned 
program Into action. Key to classroom observat/on is 
analysis of selected student work, past and prese/t. 
• 

. NOTE : Classroom observation includes informal inter- 
views with students and staff, based upon what has been 
observed, as well as the observation of activities. 



Interviews 

4 

The basic Information gained through classroom 
observation is verified, clarified, and expanded through 
interviews. Interviews enable the reviewers to learn 
how the program came' to be the way it ^s, as well as to 
better understand the program as it is and might be. 

In the two- or three-day review process, interviews 
are an extremely important source .of information about 
the program. 

Reviewers conduct both informal and formal group 
interviews. Examples of informal interviews include 
asking questions of the student* and teachers in the 
.classroom, talking wtth aides working with students, 
talking with teachers in th'e teachers^ lounge. Formal 
group interviews are conducted with teachers, aides, 
councils/committees, district personnel, support staff, 
volunteers. They serve several major purposes: 

• Verifying data obtained from other sources 

• Collecting data that have not been gathered from 
other sources 

• Resolving conflicts in data collected 
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• living people the opportunity to share past SKperi- , 
ences, present rWities, or future plans which the 

V reviewers night' not have uncovered 

s • Offering an opportunity for people to ask questions 
Review of Records and Documentation 

Information gathered through classroom observations 
and interviews is verified, expanded, and clarified 
through the review of such records* as: 
t 

• Lists of students to receive special services; such v 
as LEP, Title I/SCB, and students with exceptional / 
need 8 

• Records of Student prograss, including IEPs,.ILPs, 
and other individualized learning plans 

• Student test results, including California Assessment. 

• Program (CAP) data, o^ver a period of years 



*2 



• Minutes 



of Sst/SAC/BAC meetings ' 



• Evaluations of staff development and parent 
education activities 

• Newsletters, and other communications to parents 

• Program evaluation information, including self-> 
review'f indings ' 



Reviewers are cautioned to remember that only those 
records that promote program implementation and . 
^improvement and those that am necessary to document, 
compliance with laws and regulations should- be 
maintained by the 1 school. Therefore, do not 
overemphasize the importance of. records and documents. 

How these three methods of observation^ interviews, 
and review of records and documents are used in the 
evaluatibqof the program is described \n Chapter II. 

the' events that ocfcur dyring a program review . 

The events which. are a standard part of a review are: 

• An informal introductory meeting with the/^trff f 

• An # initial meeting with the principal 

• Classroom obervations', including observations 
of individual students 

• Individual interview* with staff and students 

• Group interviews 

• Ongoing discussions with th§ principal about the 
progress of the review 

• Compliance review with^.he principal 

• Ongoing meeting, of reviewers during the review days 
0 and evenings 

\ 
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e preparation of th*, report of the findings of the review 

• Two-it age report of both compliance and quality 
findings Including Suggested opportunities for 
Improving prog r sm quality 

- To the principal 

- To the total school comunlty 

Introductory Meeting with the School Staff 



% - Final report of findi'hgs 

Initial Inte^plew with the Principal , 

* During this interview the reviewers will seek 

Information to help them ^et started on the review. 
This Information may include: 



Arrangements should be made for a short Informal 
meeting of the school staff ' and the reviewers prior to 
the beginning of classes on tKe first morning of review. 
During this meeting the reviewers will: 

e Describe the purpose of the review: . , 

- To judge the quality of the acrifcol program; using 
the Program Review Handbook - ^, . . 



- To recognise program strengths 

iopa^about 
pmplia^ce^ 



- To make recommendatiopa^bout program improvement 

- To assess. program cpmplia^ce^ using the Guide for. 
Reviewing School Program Compliance • 



e, Describe the procedures that will be followed: 

i - Observation In each classroom include^in the 
planned program 

- Group Interviews with teachers , aides , support 
staff, councils/coomlttees, parent volunteers, 
district office staff 



e Historical perspective 'of the school, e.g. changes 
In program ancL or Implementation processes., period of 
special .funding, chafes H student population ,fRanges 
In teacher staff", ind so forttv 

e Stelf-reviev process and results 

e Final schedule for review 

e Location of documents to be studied 

e Identification of personnel ehployetf — name, funding, 
role, and responsibility 

4 

e Map .school* and schedule of classes, labs, pnd so 
* forth / 

e Any special programs not Indicated In school plan. 

e Any ether Information the principal virtea to 
• communicate to the reviewers 

Classroom Observations^ ^ _ 

A reviewer visits each classroom, resource sp4clal%it 
room, other rooms or areas where special" education 
services are provided, resource rooms » and/or learning 
laboratories, libraries and/or media centers invdlved 
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E 

in the planned program. Classrooms may -be revisited to 
verify irtformat ion. and to establish a firm understanding 
of the school program. . 

During each classroom visit, the reviewer focuses on 
what students are doing, talking to students, looking at 
their work, and reviewing records of their progress. The 
reviewer also talks to the teacher, aide, and other 
adults who may .be working with the students to clarify 
his or her understanding of how and what the students are 
learning. 



Group Interview 



jGroup 
45 ninute8« 
undetfs t and i 
staft devel 
more ghoul 



int 



The 
trviev /are: 



tervievs a<e generally scheduled for 30^ to 
s,ause the teacher interview is a key to 
total instructional program as well as 
ind translating activities', an hour or 
Xed for this interview. 

d be included in each group 




• teacher interview: 

- All regular classroom teachers involved with the 



planned program 



- Special education classroom teachers - « 
• Aide Interview: 

- Xll instructional aides (classroom, resource/media 
center. ESL y and so forth) . * 

- Special education aides « *r- 

28 



School support staff interview: ' * 

- Other nonclassroom certificated personnel assigned 
full-time to the school (resource teacher, library/ 
media specialist, Miller-Unruh teacher, progiam 
coordinator, resource specialist, and so forth) 

- Nonclassroom certificated personnel assigned 
directly to the school on a part-time basis 
(psychologist, nurse, language specialist, and the 
like) 

< * 

- Any classified personnel whose duties might be 
considered support rather than instructional 
(home/sthool liaison, parent volunteer, 
coordinator, health aide) 

) 

District support staff interview: 

- District-level personnel who are not paid 
through special program funding and who are 
responsible for the programs at the school * 
(curriculum, guidance) 

- District-leyel and SESR personnel who are paid 
through special progra m f am i ng and who are 
directly responsible to the school (program 
Specialists, evaluators, and the like) 

i , Parent and other nonpaid voluteer aide interviews}. 

- Those persona who work directly with students in.- 
classrooms on the playground in the library and - 
so forth 

- Those persons who provide support assistance 
(making materials, translating, telephoning, and s 
forth) 



NOTE; 9SC/SAC/BAC members should not b$ Included In 
thl'8 category. 

• SSC/SAC/BAC Interview: 

- All weavers (principal, teachers, other staff 
members as ..Wei- 1 as parents and community 
members) of the councils/committees should 
Included/ logistics may determine that, In a 
school with more than one council/committee, only 
one ot the groups may be interviewed at a' g^ven 
time/ In this case, be sure that each group Is 
interviewed,* 

Ongoing Discussion with the Principal ^ 

During the review, several times should be set aside 
for Informal and/or formal discussions with the school 
principal. These meetings serve to keep the principal 
abreast of: 

• How the revifw Is proceeding 

' • Areas In wClch Information Is Incomplete or missing " 

• Areas in which compliance Issues may be arising or In 
^yhich clarification is needed 

Scheduling difficulties 

m Other Information which should be communicated during 
'the Interview Including feedback on what has been 
learned about the program so far 

c 

In addition, the meeting* provide an opportunity for 
the principal to give fesrfback to the reviewers about how 
the review is being perceived by the school community as 
well as to provide needed Information to the reviewers. 



30 



Ongoing^ Reviewer Meetings 

Throughout the review, the reviewers must meet v 
frequently to ensure consistency In their perceptions of 
the program* and the process of review, as well as their 
concepts of areas for Improvement. The sever Al times 
that have been found to be* most productive for. meetings 
of reviewers are: ' 3 

s Following the f ir^L^ew^assroom visits—to establish 
commonality of observation * \^ 

s Preceding group Interviews — to determine questions 
to be explored and issues to be raised 

e At the end of each day of the review^-to * beg in to t 
determine quality ratings, compliance findings, and 
opportunities for improving for those aspects of 
the program needing no further clarification and to 
design strategies for collecting additional inform 
nation and/or resolving conflicts In information ' 

e Preceding the preliminary report to the principal* 
at which time all compliance findings, quality 
judgments, and suggested opportunities for , improving 
are finalized and the rolea determined for the last 
two reports m 

Preliminary tsptrt to the Principal ^ * 

■> 

^flrlor to the final, report to the school, the 
reviewers meet with the school principal (and anyone 
else of his or her choosing) to share their, findings of 
program qlisllty, their suggestions 4 for program improv- 
ing, and program compliance findings that will • be 
presented in the final report to the schqol community. 
If the ongoing discussions between the reviewers and the 
principal have been complete ' and communications have 

■ ' ' J 
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been open, this preliminary report should be largely a 
confirmation of the previous discussions. 

The Final Report to the School 

The final. report Includes the review team's findings of 
the quality of the school program, t it's suggestions ior 
program improvement, end the compliance findings. It is 
s report to the entire school community. For a full 
■description to the final report, see Chapter II J. 

How the Findings, of the Program Review a re Used by the 
School ' 

Since the primary purpose of program review, whether 
internal or external, is to find out how well a program 
is" working in terms of the effect it is upon the students 
snd others being served by that program, the findings of 
program review should be so stated that they can be used 
in planning activities th*\ will maJte the program more 
effective: that is, planning -what activities to continue 
and which to replace or modify. ' 

Following .the program review the SSC/SAC/BAC, along 
with other stsff snd parents, should review the selected 
opportunities for Improving to determine their potential 
effectiveness for the school program and then decide how 
to incorporate them into the program. It Is important 
for staff and parents to realize that ^the selected 
opportunities for Improving are not mandates; they are 
the reviewers' best suggestions for ,how the school, 
program might be made more effective for the' students, 
the staf fj and others of the school. 
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CHAPTER II 
CONDUCTING THE PROGRAM REVIEW 



This chapter describes how to conduct a program 
review. It is organized into three sections: The — 
Effect of Instruction on Students; The Effect of Support^ 
on Instruction; and the Effect of the Improvement 
Process on Support and Instruction. Each of these 
sections contains: (1) the criteria - for judging 
quality, (2) a guide for collecting information, and (3) 
Opportunities for Improving work sheets, which are used~ 
to prepare suggestions for progran improvement. 

A. USING THE QUALITY CRITERIA 

The Ctlteyia for Judging frailty 

The quality criteria --are intended to describe the 
effect of activities on the client, (e.g. , the effect on 
the students of instructional activities and the effect 
on instruction of support activities). Each criterion 
it referenced to a aeven-poinlr scale from high 
effectiveness to low effectiveness. This scale is 
anchored by three paragraphs .which describe what a 
school program looks like from the perspectives of high, 
middle ,^ and low effectiveness/ The reviewer's job is 
to decide which description best fits the aspect of the 
program tfelng reviewed. The intermediate points on the 
Wale are for use when an aspect of the program is 
judged a bit more or lesq effective than these anchor 
descriptions. These scales are designed for us? with 
the review procedures described in the handbook and with 
the guide' for collecting Information that follows each 
quality criterion. 



' The quality criteria for each section both describe what 
-the reviewers* are seeking to learn' a&out a p£ogram and 
provide a framework for > making judgments about the 
effectiveness of each aspect of the .program and 'how that 
effectiveness might be enhanced or sustained. In using these 
criteria^ reviewers must observe the effects of instruction 
* otv students and decide which descriptive paragraphs in "How 
Student 8 Are teaming", test describes what hat been 
observed. J^y must' also ga}* sufficient understand^ of 
what the Instructional program is, how 1ft came to be the way 
it is, and how staff and others are carrying out the program, 
tp determine what cpuld be done to make the program more 
effective for the students. . ' 

The Guide for Collecting Information 

The guide forf collecting Information about each criter- 
ion identifies" areas of investigation, primary sources of 
information, and verifying sources of 'information. The 
phrases in the "Area of Investigation" column are directly 
related to ' the descriptive paragraphs of the quality 
criteria. They represent the major topics or themes under- 
*ly4a$ the three descriptive paragraphs of each criterion. The 
second column, "Primary Sources of Information* identifies, 
information to be pursued either by observation or by group 
interview. The third column, ' "Verifying Sources of 
Information" identlflqp substantiating facets that are to be 
pursued &y observation, interview, and document review. 
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In using this guide to find out "what is" in- the 
prograa under) review and tfhy it is that way, reviewers 
should note the following instructions: 

* 

• Choose which questions to pursue, when and how*. In „ 
so doing, allow , the actual structure of the 
classroosi — the .activities In which Students are 
engaged at the* moment — to guide the choice. Follow 
the clues as they present themselves; do not try to 
pursue all questions to the sane depth In all 
classrooms for all students and/or teaching* 
staff. 

• The ultimate purpose of the review Is to Judge the' 
effectiveness of "what Is." as It relates to 
benefits for students. Do not use the questions as 
checklists or as lists of events whose existence 
must be verified.. ' 

, • As* much as possible, pursue answers to* sevetal 

questions simultaneously. The Interrelationships 
w «>ng the answers are often moVe Important than 
" » verification that isolated events are occurring. 
This IS especially true in linking Instruction to 
suppojt and In linking 'both instruction and 
support to the improvement process. . 

• First, form a Clear picture of what the program is*, 
then judge Its effectiveness. Do not make 
judgments about the effects of instruction on 
students, the effects of Support on instruct 16n, or 
the efferfc^of the -improvement procesa^until 

your plcyire of what is happening is Complete. 
Premature judgments about effectiveness can 
seriously dlstort^both your further Investigation 
and your conclusions. * 



Opportunities for Improving 

•i 

Immediately following the guide for collecting 
information Is a work sheet with opportunities for improving 
statements. These statements describe wh*t the adults who 
provide services are doing or might do, to achieve beneficial 
Impact or effect on the client. The intent of the quality 
criteria ratings Is* to give the school a status report ^on the 
effectiveness of the current program. The intent of the 
opportunities for Improving Is to aid the school in moving 
from the. current status toward Improvement by suggesting 
areas on which the school might next focus In its ongoing 
planning progress. 

^In- selecting opportunities for Improvirig, reviewers 
draw upon their understanding of the school program to 
identify activities that; 

- Would focus on the key or underlying cause for the effect 
om the client. 

- Would jiave the greatest Impact on the program, leading , 
to improved effectiveness In many areas?. 

- Would be thd best next step to take in an area "ripe" for 
improvement-^hat Is, where stfrff interest 'and 
motivation in high, where there can be high yield for 
efforts expended and which is small enough In scope to 
ensure success. 

( 

The selected ppportunitles then are expressed so tfs to 
recognize and encourage utilisation of the school's Improve- 
ment processes of planning, translating and evaluation. 
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*B. MAKING JUDGMENTS ABOUT PROGRAM QUALITY 



Judging program quality 

Over the course of the two or three days of the 
review, the reviewers will be pullir« together the 
evidence they have collected into a picture of the 
school program. In m^fclng a quality judgment, the 
reviewers compare this evidential picture with the three 
descriptive paragraphs which anchor each quality 
criterion. The revelwers determine the quality rating 
by deciding which criterion description best fits their 
picture of the school program.* 

In making judgments about the quality of each 
aspect of the school program, reviewers must adhere to 
the following instructions. 

Responsibility for evidence and explanation 

Because the. accessibility and quality of evidence 
at a school will vary considerably, the Issue of who is 
responsible for providing evidence and explanation Is 
crucial. The reviewers and the school must understand, 
their respective responsibilities In establishing 
"proof." As used here, * proof - does not mean scientific 
or m legal proof, but rather "reasonable conclusion" 
based on the best available evidence. 
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Generally, as the judgment goes from jthe middle to the 
high end of the scale ' for any particular criterion, the 
burden of responsibility shifts toward the school staff. As 
the judgment goes from the middle to the low end, the burden 
shifts to the reviewers. In making judgments, tip reviewer 
should use the following guidelines to ensure that the burden 
of responsibility is placed correctly and consistently. 

e When evidence begins to Indicate that an aspect of! the 
school program fits the higher end of the scale, the V 
schodl staff has a responsibility to provide 
Information, to direct the reviewers' attention to * 
examples, and to explain how the program works for al} 
th^llents. The staff must also explain how the 
program reaches all of the Intended students, rather 
than just some. The reviewers have the responsibility 
for requesting and listening to these explanations, 
pursuing their investigations .through observations, 
Interviews, and record search, until they have enough 
evidence to judge what is going on in instruction and to 
rate it accordingly. J • 

e When evidence begins to Indicate that an aspect of the / 
school program fits the lower end of the scale the 
burden of responsibility shifts to the 9 reviewers to 
identify the . limitations of the program for the review 
criteria under consideration. That is, the reviewers 
aust understand what Is happening end be able to explain 
the evidence they have found of lack of effectiveness. 
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NOTE: »ck of evidence of effectiveness is quite 

different from evidence of lacK of ef fectiveness^ 
Failure to find evidence is a failure o^the^y^ 
* review process for ifhich both the rGVieUfrs and* 

* . the school share responsibility. 

What to do when a program vquality seems to fit a im- 
mixture of- descriptions 

The quality criteria fop instruction ar6 wmtten in 
tens ,of ,an individual student. In any school being 
reviewed, there will probably be some student^ whose 
Inspection fjts one description' and other students 
.whose instruction fits a different description. f To 
determine how to r judge the Equality and effectiveness of 
an aspect of the instructional -program which is best 
described with a mixture of criteria descriptions, 

use the fpllovihg rules: h. * 

• # * 

• Virtually all students should be receiving ins true- 
> tlon of /high (or low) quality to judge as aspect ^ 

of the instructional program as high (of low). 



For, any judgments of quality, the reviewer's primary 
responsibility is to make the best possible judgment. Making 
judgments of quality is not just a technical procedure, so 
reviewers should aof expect to^glve a t<*chnic*l explanation 
of tow judgments were derived. The techniques described in 
this handbook art designed to improve the ability of trained 
educators to gather complete information i*P<> n which to make 
judgments, and to ^provide betfeerv^eedback to the school, and 
to make the judgments of program review r^essary in applying 
~the criteria, more consistent. Nonetheless, these techniques 
cannot replace the reviewer's own ability to make value the 
mentr.. 



bifficulties in Judging Quality 



•» matter how well-designed the-' .procedure or how 
well-prepared the reviewer, there •will" always be difficulties 
in making judgments of quality. The difficulties have lead 
'to different consequences for each school. Reviewers should 
be awace of these difficulties and the potential consequences 
of each at the school being reviewed. ^ 



. If the l «a)|ority of students are receiving high (or 
low) quality instruction, the rating would be 
' • * between middle and high (or low). 

^v' • Use the middle ratingGox^ao evel^iixture of "high 
and Aow ^\ 

Be especially >alert to how the program^ is meeting the 
needs of the ^educatJUmally disadvantaged*, limitjed- 
- • 6ngl*sh-proficient (Wtt, gifted, and talented students, 
and student* with eHee^l&nal needs. 



— Ove r g e ner a ll^i ng 

Ml 




Necessarily, the review is limited to a "slice of tim^ 
samplel of situational time, intervals, , curriculum content; 
students, and A Merely assuming that this limited 
sample \is typic«P£ a mistake of overgeneralization. To 
avoid 6vergeneral7tation, support the initial generalize- 
' tions from observed samples by relating what students are 
doing to the work they are producing. Then relate this 
• current 'work to samples of past work from the last several 
weeks. - .Discuss pa-st and current work with the student 
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at further clarification and support for generalizing. 
Discuss the observed activities apd students' work with 
{he teacher, and £sk for explanations of how the 
activities fit In with the overall program for the year. 
The teacher 9 8 explanation is an Important step in 
generalizing. Finally, try to relate observations In 
the various classrooms to school vide programs and plans 
for programs. Discuss this relationship with the 
teacher, with people active In planning , *nd with school 
leaders; especially the principal. By ' fitting 
observation and explanation togetheV In this way, It is 
possfSle to Construct a historical picture of the school 
program and tie It to the observed experiences of 
students. It Is this picture and the tie to students 
which * provide the framework for generalizing frgm 
specific observed data. 

^ 

Too Impressionistic 

While initial Impressions are a valuable guide *for 
pursuing a line of ■ investigation, they should be 
validated or relectd fr y esref^l 
appropropriart evidence. •Thia evidence should Include 
teachers' explanations, students' work, or clasferdom 
observation. Initial impressions can be based , upon 
, situations which are not typical of the school. Do not 
let these Impressions color the review without verifying 
them. 

Too analytic 

N 

The reviewer should not just set upon the school as 
an active Information gatherer, ferreting and figuring 
the whole time. This can lead to simply collecting data 
for the sake of data rather than looking &>r . the 
qualitative effect on the program. Reviewers Wtfould 
giye the school an opportunity to disclose itself Art its 
own way. Reviewers should, therefore, spend some time 
quietly allowing the atmosphere and tempo of life at- 
that school to present Itself. , 



Personal bias for /or against specific' materials or programs 

Use the criteria and procedures in this junual. 
Reviewers should keep in mind that "whjlt would not work for 
me and mine might work for them and theirs." Reviewers musr 
be certain 'to observe how <a program works ^for -the school, 
rather £han judging how it would "or did work for them. The 
personal bias error can go either way. Just because a, 
program was best for a reviewer at his or her school does not 
mean" that it should be judged as effective in another 
school. ' 

9 

False posltlv^ 

\ 

This costly mistake occurs when a school staff is doing 
a poor or mediocre job, and tiie reviewer tells them they are 
doing * very good job. When' this mistake is made, the 
Incentives for Improvement are undermined and the arguments 
tot maintaining the status -quo are reinforced, by the review. 

False negative 



Although this mistake can be most upsetting^ it is not 
always as bad as the false positive. , Schools which are 
judged more effective than the effects described in the 
middle criterion paragraph are often upset that they did not 
get, the top rating (just as "A" students complain the most 1 
over "B+" grades). In many cases, these schools are strong 
and confident enough In their self-review to brush off the 
effect of a false negative. In some cases, however— 
especially in Schools which have made progress from a loweA 
rating "to middle or above — a false negative rating can b* 
demoralizing. ' * ^ . 

Reinforcing facades 

Any type of grading system has aspects which resemble a 
game. A costly mistake Is ' the collapse of the review 
process-vhich Is Intended to have a real and positive* effect 
on the education of studehts~into a game. While concern for 
"fairness" Is very Important, It is less Important than 
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concern for the real Job of .educating students. Over- 
attention to the technology and proceduree of program 
review may eubvert the intended effects on education 
and create a "fair" but expensive and wasteful game. 
Soae school and district personnel complain that trying 
to do well on program review forces thee to waste tine 
building facades instead of teaching the students. 
Reviewers should not reinforce facade building^ in 
schools which wsnt to do well. Reviewers should 
concentrate on students' learning Uather than 
paraphernalia of instruction. 



C; THE EFFECT OF INSTRUCTION ON STUDENTS . 

This section contains seven quality criteria, each 
of which is used to Judge the. ef fectivene»s of an aspect 
of the student's instructional program./ Each criterion 
is accompanied by ^ guide ^for ^collecting information 

for improving that area of instruction. 

The first three critetiaf are used to Judge the 
effectiveness of * the instruction received by all 
students neTjicipating, in the planned program including 
limited-English-proficient, educationally disadvantaged, 
gifted and ' talented students, and students with excep- 
tional needs. .The criterls are: 

• How Students Are Learning ^ 
s What Students Are Learning 
. e The Environment in Which Learning Takes Place 

The next three criteria are used to Judge the 
effectiveness of the special services provided students 
with specisl needs. These criteris sre: 
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• The Effect of Excess Cost Services on Educationally 
Disadvantaged Students 

• The Effect of the Bilingual Services, on*Li«ited- 
English-Proficient Students 

s The Effect of Special Education Services on Students 
with Except ionsl Needs 

The final criterion is used in schools receiving School 
'improvement funding to Judge the effect of the totsl program 
on the student. It includes sll areas of the curriculum bnd 
all services received by the student over time, snd spp.lies 
to each student participating in the planned program. The 
criterion is: 

s The Effect of the Student's Totsl Program on the 
Student 

This part of the review focuses on the individual' 
atudent. Each area of instruction mist be viewed from the 
perspective of its . Impact on the le «" V«. og , _ c *° h !f U , < j!"^ 
including LEP, educationally disadvantage*! »tud«ftfc», *Ud*nt* 
with exceptional needs, and gifted and talented students. 

How To Look For The Effects Of Ins truction On- Students 

Each participating classroom, resource specislist room, 
rooms or areas where other specisl education services sre 
provided, library and/or media center and resource center 
and/or ' learning laboratory must be visited- I • " 
recommended that 20 minutes be devoted to the initial visit 
to each classroom. Not all of the areas of investigstion 
identified in the guide for collecting .information need to be 
explored in every classroom, but each should be verified in 
seversl classrooms. Classroom visits should be structured to 
make the most of the time available. 

4.4 



/• 

Upon entering the classroom, sp^nd a few mii^jtes 
developing and understanding of what Is happening wfthin 
the classroom: / 

• -'J ' 

• Look at the physical environment 

• Observe the students and what they are doing 

✓ , 

• Observe how students are grouped and how individual 
' assistance is, provided 

• Observe the teacher, aide, and other personnel 
(parents, tutors / support staff) as they work with 
the students 

^ • Listen to the questions asked by students and <the 
responses they receive 



Remember at this point that, as a reviewer, you are 
putting together an Initial picture rather than maklrg 
judgments; each impression will need to be * verified 
through further observat ion and irnforaaT^ Interview as 
^ well as through other sources^ and that f irst^impress- 
* ions may be influenced by personal bias. 

Using* clues gathered while putting together the 
initial picture, select a few students for in-depth 
study, including ,one or sore with special needs, such as 
educatidnally disadvantaged, gifted and talented, LEP 
students, and students, with exceptional needs. 
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INITIAL CLUES 



What are the selected students doing? 

- Receiving instruction 

- Applying skills 

- Discussing concepts 

- Acquiring • information 

- Waiting 

- Playing * » ' 

- Practicing newly acquired skills ?. 

- Teaching each other \ 

- Synthesizing .and evaluating information 

- Watching • 

- Attending to an unrelated task 

- Causing a disturbance ' 

How much time does the student actually spend on the 
assigned activity? 

# 

How much time is the student receiving attention from 
the teacher? /■ — 

Is the student receiving tjie teacfier's attention for 
"TlisWucrioYn tor per^iu^^TnF^r cement , for 
discipline? 

* 

How much time is Che student receiving attention from, 
other adults (aides, volunteers, special 
education teachers)? 

Are students with expectional needs participating in the 
classroom activities? \ 

In what activities are the edupationally ( disadvantaged 
students engaged? The students with exceptional needs? 

Are LEP students being instructed or tutored in a 
language other than English? By whom? 

Does the size of the student group vary? Is the size of 
the groups appropriate to the activity? 

Do students complete the activity on which they are 
working before they begin » new activity? 
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THE EFFECT OF INSTRUCTION ON STUDENTS: HOW STUDENTS ARE LEARNING 



This criterion focuses on the extent to which the 
instruction received by each student is responsive to his 
or her needs, strengths , interests and ways of learning, 
tfcus enabling him <pr her to be successful as a learnet. 

How students; learn involves instructional issues such 
as: (1) responsiveness to individual student needs, 
strengths, and interests, and ways of learning; (2) the 
activities in which students are engaged (including 
materials, instructional methods, and grouping); (3) use of 
time for- activities (4) N extension of learning; and (5) 
oppo rtunit ies to apply skills and knowledge learned in one 
area of the curriculum to other areas. 



NOTE: 



The tens "ways of\ learning" includes the setting in 
which a student learns best, such as more or less 
.structure d , Indepen d ent l y o r gro up , a s w ell — 
as his or her preferred methods of receiving' aod 
processing information — visual , auditory and/or 
kinesthetic. 



In determining how students learn, focus directly on what 
the individual students are doing rather that on how the 



adults are teaching. Determining what adults do to 
make, learning happen is used -to test and verify 
what you find the students doing: Thue, the 
investigations begin with what the students are 
doing. 

Note that a key indicator of student learning 
is the extent to which his ^or her instruction 
matches his or her needs, Interests, strengths, and 
ways of learning. The clues that you have gathered 
through initial classroom observation wd.ll give you 
some Indication of Jjow responsive the instructional 
program is to student needs. Follow those clues* to 
determine how responsive instruction is to the 
individual students in your sample. . Then, seek 
additional information that will, enable you to 
gen e ralize tr o m 'yum — sample ""'students T<T 
classroom as a whole. / 



the 



Apply"" theN^riterlon How Students Are 
Learning to each areaWHAc curriculum under 
review. 
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OJRRICUL/tf AREA 



CRITERIA FOR JUDGING QUALITY 
•THE EFFECT OF INSTRUCTION ON STUDENTS: HOW STUDENTS ARE LEARNING 



This criterion fbcuses on the extent to which the instruction received 
by each student is responsive to his or her needs, strengths, Inter- 
ests, end ways of learning, thus enabling him or her to be successful 
as a learner. ^ 



In applying this criterion consider: (1) The planned program being 
Implemented this year;' use a separate page for each curricular area, 
• writing the name of the currlcular area in the space above, (2> All 
students participating in the planned program, Including students 
receiving special services (gifted and talented, LEP, Title I/SCE, jind 
students with exceptional needs). 



The student is restless, and not Interested 
"In the learning activity in which he or she is 
engaged. He or she Is not attending to the 
task and is frustrated by the iearning 
activity. The student is confused about what* 
to do or how to do # it and does not know the 
purpose of the activity, Instructional 
activities for the student are frequently the 
sane as those for his or her classmates, 
"wltTiout recoyiitl5h-"Tjr~ his Ui \m reeds, - 
strengths, interests, and ways of learning. 
Opportunities to practice skills and concepts 
are limited; many skills and concepts are net 
being mastered or extended; and .continuity of 
learning experiences ' is lost throucji 
interruptions. Opportunities to apply skills 
and concepts in other curriculum areas are 
limited; each curriculum area Is treated as 
separate from others. The personal and social 
needs of the student are seldom considered by 
staff when planning his or her learning 
activities ot assigning him or her to groups. 



*he student is interested* In the activity in 
which he or she is engaged and generally Is 
attentive to the task; there Is little 
Interruption due to confusion about what to do 
and how to do It. The materials the student 
uses and the activities In which he or she is 
engaged generally mate* his or her needs and^ 
strengths; materials and methods of 
instruction sometimes take into .account the 
ways in wnxen tne sxtjoent icbihsf o , *> = 
her educational interests. Student work 
Indicates that he or she experiences success 
in learning the necefesary skills and concepts 
of the curriculum and has some opportunity to 
extend, bring together, and apply the skills 
or concepts. There is an indication that the 
personal and social needs of the student are 
considered by staff when planning for his or 
net » learning activities and when placing him 
or her within groups. 



The studeqfr-is actively engaged in learning 
activities; be or she is attentive to the 
task, and his or her interest and mctivatjpn 
for learning is hitfi. The learning activates 
*re not only challenging for the student, but 
also are successful learning experiences. The 

^materials that the student uses and the 
activities in which he or she is engaged match 
his or her particular interests and ways of 

' learning as ft 1 1 °* — hi*_ nr u twfr .needs, .and. , 
strengths. Student work indicates that the 
student has sufficient opportunities to 
practice, extend, bring together, and apply 
the Identified skills and concepts of the 
curriculum; hPor she knows the purpose of the 
activity trd expects to achieve that purpose. 
The settings i^^ich the student works and 
thfe working r^ftonship with other students 

, and adults erxlwage the personal and social 
development of the student as well as his or 
her acquisition, extension, and application of 
skills and concepts of the curriculum. * 
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GUIDE FOR COLLECTING INFORMATION ABOUT HOW STUDENTS ARE LEARNING 



Area of Investigation 



Activities in. which the 
student is engaged 



Primary source of w information: 
classroom observation 



# Verifying sources of Information : 
Interviews/documents 




Are the students working on the same skills 
using different act ivit ies in recognition of 
their different ways of learning? 

How are Reaching methods varied according to 
what is to be learned and the needs and 
strengths of each student? ' 



Are students at all performance levels Involved 
in c^llenging and productive activities? 

To what extent is instruction leading to 
accomplishment of objectives (in IEPs, ILPs, and 
other individualized programs)? 



"Ath^ students at some levels 11ml ted to passive 
teaching, such as repetitive desk activities? 

T.o what extent is direct instruction a part of 
the student's dally instruction? 

Does, the student understand what he or she is 
expected to do, how to do it, and why? 

Can the student relate what he or she is doing 
to what he or she has done or will do? 

Has the LEP student understood direct ions for 
the activity and what he or she is to ,do? 



Explore with both teachers and , 
aides : The role of the classroom 
aide; how the aide assists the 
student ; who determines what ,the 
aide does with whom and how; who 
determines what the student does; 
who determines services for Title 
I/SCE, LEP, gifted and talented, 
students with exceptional needs, 
and gifted and talented students; 
who determines what the needs will 
be and how they will be carfcled 
out? 

Explore with support staff : How 
support staff are involved In 
determining what students do; what 
they do directly with students, how 
they accommodate different learning 
styles, needs, and strengths of 
students 

Explore with classroom volunteers : 
How classroom volunteers assist the 
student in learning 

Documents : . List ofVutle l/SCp, 
LEP students; teacher aide lesson 
plans , I£Ps , ILPs , student records 



Does the LEP student receive instruction in his « 
or her primary language?- Is that language used 
in a way which supports learning in the various 
subject areas? 

In what' kinds of compensatory activities is the 
Title I/SCE student'' Involved? Do they appear to 
meet his or her needs? 
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Material* 7 t^^txident is 



> V 



7 C?' 

Student success as 
a learner - 

* : • 



How students* are grouped? How flexible" Is the J 
grouping? | 

Do the materials fit into the purpose of the j" 
activity? J I 

Is the student using the materials to accomplish 
an intended objective? ( 

Dp the materials match the student's needs, 
strengths, interests , and ways of learning? 

' Is a Variety of materials used in teaching the^ 
same skill? 

Are appropriate materials, m«*dia, and equipment 
available in the classroom for LEP, -Title I/SCE, 
and individuals with exceptional needs to met 

' stated objectives? ' * 

* : - 
Does the' student, know ^will look at his or 
her work and when? w % 

~ .Does* he ot she know what happens if .the work is 
not done correctly? * 

. Does the way # in which the ' student * receives, 
feedback reinforce learning? . 

How timely is the correction v of student work?- 
^Does the student's work Undicate general 
success, repeated failfre, or • rf pitition of 
skills already mastered? , ♦ *\ 

Does reteaching take place when a student's wc*k 
need? Who does it? 
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/indicates the nee 
' Will ' the student 



win cne 8 Lu U «.a leirn the preSrib^d skill or 
concept by doling the assigned activities ^and 
using^the assigned materials?^ 




Area of Investigation 



Personal and social needs 
of the student 



^/ Student opportunity to 
apply and extend 



Primary source *of information *: 
classroom observation 

Is there evidence that the staff recognizes the 
personal /social needs of the students? 

Do the students work well together? 

Is there evidence that students are learning to 
become socially responsible? 

How d<? the working relationships between 
teacher/ aide appear? Teacher support staff ; 
aide/>tplunteer; adult/student ; student/student , 
and so forth? 

How does the student apply what has been learned 
in other -areas of 4 the curriculum? 

Are there a variety of .approaches for a student, 
to use in applying learrwAbasic skills? < 

r Doe8 each student, including LEP, educationally 
disadvantaged, gifted and talented, and students 
with exceptional needs, extend and apply skills 
appropriate to his or her level? Are there 
extension or application actiyiti^s for remedial 
instruction? 



Verifying sources of information ; 
interviews/documents 

Documents : Assessment information 
including silf-concepf inventories; 
psychologist , nutse records; IEPs; 
absentee records . 



Explore with students ; What 
textbooks and materials students 
use and how often, what other areas 
of the .curriculum they experience 

Explore with*' teachers : How 
different basic skill levels are 
accounted for in other areas of the 
curriculum; what techniques are ' 
used to encourage students, to apply 
basic skills - 

Documentation : Teacher lesson plan 
book, learning centers, variety and 
tange of books 'and materials, *IEP. 
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OPPORTUNITIES FOR I PROVING HOW STUDENTS |£flRNING 



4& 



The statements listed below indicate actions -*ich may have been or 
need to be taken to improve the effectiveness of your program. The 
specific opportunities selected by the reviewers reflect their 
. JSistandlTof your program and their best suggestions for *at your 
next steps might be to make your program more effective for students, 



a. Ensure that those 'who work with students know each student's needs, 
trengths, and Interests. • 




staff and others at the school. The SSC/SAC/BAC along with other s af f 
and parents should review these suggestions, *termlr* their ^tentlal 
effectiveness for program lpprovansnt , and then decide how your ongoing 
planning, translating and evaluation procedures will be used to 
incorporate fehem into your program. > 

Selected Opportunities for Improving 
^ 4 



b. OeteSHae «hat each student has learned and has yet to learn In each 
of the*NB»lc areas addressed In the school plan, and all indi- 
. , viduaiizedftarniro plans. Reexamine sutf assessment frequently 
enough to be current with the student's growth. 

c Assess each student's social and personal development, Including 
SarenJs, knowledge, and understanding of different ethnic groups. 

\ A Plan each student's daily work based on assessment of *af~the 
V * stSerTalrlaoT^ow and has yet to learn, his or her interests 
- ardltrengthsTand the way in *ich he or she learns best. 

» f>nn Mri /tar olio students in accordance with their needs, • 
SreVhT?\^sts, w^Tof learning, and *at is to be learned 

' USste individual' learning, small group, large group, *>ole 
group). 

f Use a variety of teaching method* to meet each student's needs,' 
strengths, Interests, and ways of learning. 

g. Use materials and activities «hich allow students to build on their 
* - strengths and interests. 

h Set appropriate standards and expectations for all studsnts, and 
1 make those clear to the students. 

i Menage instruction in ways «hich minimize disruptions end allow 
stCSnts Efficient time to acquire, extend, and apply the skills 
and concepts of the curriculun. 

J. Provide timely feedback to students about their work., • 

k. Provide opportunities for students to practice and apply skills and 
poncepts being learned 

' « l. Coordinate and use all available resources so that ■^•f*«J $ » 
i'- fS7 talents Of parents. and coimunlty members, and special skills of the 
school staff support eedi student's continuous progress. 
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Guide for Collecting Information To Determine Opportunity For Improving How Students Are Leaning 



After observing the students at work and talking to 
them about that work, continue your investigation to 
.determine what has created 4 the effects you have 
observed. Ixjpk at how the students are assessed .by the 
teacher to determine what they have learned, what they 
need to learn, and how they learn best. Look at how 
assessment information is used to determine what the 
students should do and how they should do it. Look at 
how students and adults are spending .their time. 



U#e the information gained in this pyt of your 
investigation to identify opportunities for improving 
the effects of how students are learning. As you 
proceed through the review, use this same 
process—finding . out what is, identifjing the 
effect of what is, and then investigating why the 
" effect is as it is — in order to suggest opportunities 
for improving or sustaining the effectiveness of each 
aspect of the program. Ni 



Area of -Investigation 



Student assessment 
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Primary Source of Information : 
Classroom observation 

Is Inforaatlon collected about the academic 
progress of the students in all subject areas? 1 
(as appropriate for students with exceptional 
needs)? * - . s «^ 

Is information collected about the student's 
personal and social development? \ 

Is information collected by testing and observ- 
ing; by analyzing students 1 work; by confering^ 
with parents, stjudents, and/or other teachers? 

If asiestfment is made by other than the class- 
ro<n teacher, how does the assessment informa- 
tion become part of the teacher's working know- 
ledge of the students? 



11-14 



Verifying Sources of Information ! 

interview/documents ' 

Explore with teache/s and support 
staff : How the methods of assess-" 
ing students were designed of 
sele >how the information is 



used; hQw/bften reassessment occurs 
and why; how consistently the 
information is used (from class and 
grade to , grade); how helpful 
assessment information is in guld-* 
ing the learning of students; how 
the information is articulated* 
(from grade to grade and classroom 
to resource or media center). 

Explore with aides ; How aides are 
Involved in assessing students' 
needs, strengths, and ways of 
learning; their responsibility for ' 
maintaining any records; how they 
communicate what they learn about 
students to the- teacher. ' 
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■ Area of Instigation Primary source of' information: 
classroom observation 

How groups are established Are decisions based on 'tasks and concepts or 
• 8 P skills to be taught? On personal ,. social , aca- 

demic needs and strengths and language abilities 
of the students? -On the capabilities of the 
adult(s) who will work with the students? 

Do practices, .allow for movement in and out of 
groups as indicated by individual needs? 

How are students * with exceptional needs, LEP, 
Title I/SCE, gifted students, and so forth 
grouped for instruction? 

How is current assessment information use4 in 
determining their grouping? 

,Do students have the opportunity to work with a 
variety of other students in both social and 
academic settings? 

How the classroom schedule Are decisions about the £l««o- ^f" 1 ^ 8 ^ 
is determined on the task, skill, or concept to be -taught? On 

personal, social, academic needs and strengths 
and language abilities of the students? 

Does the schedule provide adequate time for les- 
sons (complete introduction and sufficient 
exploration/ practice* in ordaj^ to maximize 
retention)? 



Verifying Sources of Information 
. interviews/documents 

* 

Explore with teachers : How 
students are grouped; how flexible 
the gr^teng is; how he or she 
determines the activities each 
student or group of students should 
be engaged in; how he or She works 
with the student or groups of 
students; how he or she works with 
the aide; how what the students *re 
doing now fits into a larger ' 
timeframe: the last few weeks or 
the plan for the year. 



61 



ERJC 



Does the schedule ✓provide adequate time for Documents: Lesson plans written 
completion of the assigned task? classroom schedules , . IEPs , ILrs. 

What curriculum priorities does the schedule 
reflect? Is adequate time, allowed for other 
areas; e.g., fine arts, social studies, and . 
science, as well as bas*c skills? Is time 
allowed for personal and social development 
activities? Is time allowed for English-as-a- 
second language and/or primary language 
instruction? ♦ 



€2 



Area of Investigation 



Primary source of Information : 
Classroom observation 

Do* teachers , aides, other teaching personnel, 
and. students conduct ongoing assessment? How 
timely are the assessments? 

How is ongoing assessment information being used 
to decide the activities in which the student 
should be Involved and the materials he or she 
should be using? 

Do students participate in their own assessment? 

How is assessment information transmitted 
between classroom teachers and specialist 
teachers? * * 



Verifying sources of information 
interviews/documents ~ 

Documents : Test * scores; classi- 
fied/ individual student progress 
records; personalized teacher 
record keeping system; report 
cards; surVey data; any other 
assessment Information; support 
staff records of student progress 
and articulation or communication 
with classroom teacher; individual 
assessment plan • 



How the classroom Is 
organized and managed 



Is only pertinent information shared, thereby 
respecting confidentially or personally identi- 
fiable information whenever possible? 



If there ^s an indication that * a student may 
need special education, does the regular teacher 
know the referral procedure? 

Does the regular teacherj_earticipate in tlie 
special education assessment of individuals with 
exceptional needs? 

How does* the teacher decide with whom the 
student will work (teacher, aide, volunteer,* 
peer)? How are decision^ made about who works 
with educationally disadvantaged, LEP, talented 
and gifted students, and . students with 
exceptional needf. 
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Area of Investigation 



Primary source of information : 
classroom observation 



Verifying Sources of Information 
~ " interviews/documents 



How does the teacher* make decisions about 
1 fc what activities, should, be extended outside the v 

classroom and how? 

s 

How does the teacher use his or her time? , In 
direct instruction with students; in planning r . 
lessons; in response to student requests* for 
help; in planning for instruction; in directing 
the students; in directing other adults, aides, 
and volunteers? 

How do the aides use their time? In working 
with students individually and in groups, in 
preparing < materials , in implementation of IEPs 
and ILPs, in record keeping? How does the aide 
. plan with the teacher? 

How does the teacher ensure that the time the 
student is engaged in learning activities is 
sufficient to learn what is to be learned? 

Do specific groups, such as individuals with 
exceptional needs, LEP, Title I/EDY, and gifted, 
tend to. Receive most attention .from either the^ 
teacher or the aide? . V 

How student learning How are decisions made about what materials the 
activities are directed' student will use and in what kinds of learning 

activities he or she will be involved? Who 
makes them? 

To what extent are the decisions based on knoy- 
ledge of what the student has leaVned and 'needs 
to Learn next? 
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65 If homework is assigned, is it for all students ^ 

. or some students? How is information about , , ~* 

^ , homework fed back to students? Is it timely? 



THE EFFECT OF INSTRUCTION ON STl^ENTS: 



WHAT STUDENTS ARE LEARNING 



This criterion^focuses on how effective the instruc- 
tion received by each student in each curricular area in 
enabling hin or Iter to**" acquire successfully necessary 
skills and concepts of that particular area and to apply 
then to. other learning. ♦ 

• »- 

What students are learning involves issues of curri- 
culum - completeness of content, ilent if i cation of skilly 
*and concepts to\ be learned in curricular areas included in 
the planned program 4hd individual learning plans, and the 
range ami depth of content available for matching the 
range' of j student heeds, capabilities, and educational 
intercede* *or purposes of the review , curriculum is 
defined as the instruction in skills^and concepts' that 
students actually experience rather than as tfie school's 
or district's course of -study. # 

0 In order 'to develop a more thorough' understanding of 
instruction, evaluate the curriculum as it exists for the 
student and determine how decisions are made about what the 



student will learn. Plan to observe instruction in 
each of the curriculum areJs under Review* 

During cj^sroom observation, look* at the part 
of .the curflculfcra -in which the student is working 
during classroom observations. A , review of the 
8£Mdent 1 8 past work^and individual learning plans 
vill # give clues to what skills, and/or knowledge* 
have been taught, A review of the classroom 
materials and skills and concepts to be learned 
will gjjre clues to what is ..being and will be 
t*»g|it.' Determine whether' the subject matter atea 
is^VjAtad , enough in scope to be appropriate for. all 
WftdCTM - in the classroom, including those 
receiving special services^ <gif ted and talented, 
LEP, 1 speplal education, Title I/SCE), 

w Appier *the cj^Lt^rion for "What Vtudents Are 
Learning" to each area of thf curriculum under 
review* 4 * - 
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CRITERIA FOR JUDGING QUaJJ^Y 



OJRRICUtAR AREA 



EFFECT OF INSTRUCTION ON SfUCENTS: WAT STUCENT5 ARE LEARNING 



This criterion focuses on how effective the instruction received by 
each student in each curriculum area is in enabling him or her to 
9 acquire successfully" the necessary skills and concepts of that 
particular area and to apply them to other learning. 



In applying this criterion consider: (V) The planned program being 
implOTented this year; use a separate page for each cflrricular area, 
writing the name of the^curricular^ area in the space above, (2) All 
students participating in the planned program, including student? 
receiving special services (gifted and talented, LEP f Title I/SCE, and 
students with exceptional neteds). 



The curriculum % which the studint is 
experiencing is incomplete; the student doe% 
not receive instruction in all appropriate 
areas within the curriculum. The work of the 
student indicates thaC the skills and concepts 
ha or she is to learn are not clearly defined 
and that, standards and expectations are low. 
student's work also indicates that the 
(arning experiences of the student tend to be 
too easy and repetitious or too difficult and 
frustrating. The re ate few opportirities for 
the development of critical thinking skills 
and' ' independent /fiMgrnent included in the 
curriculum. 




The curricula which the student is exper- 
iencing is complete in most major skill areas; 
in sane areas, it lacks sufficient range for 
the student, most essential skills and 
concepts of the cirriculiin/fiave bepn defined, 
as have standards and expectations. The 
student 'receives instruction in the essential 
skills *id v concepts; higher lev* learning 
experiences are* limited. The student's daily 
work often is sufficient to challenge his or 
«her ability and to provide productive learning 
experiences. Some opportunities are provided 
ftp students to' bfevelop critical thinking 
skills and independent Judgnent, but indica- 
tions are that development of the desired 
skills of critical thinking and independent 
Judgnent are limited. 



E/5 • 



The ciffriculun *Mch the % student is experi- 
encing is complete in the major skill and 
concept areas* with sufficient range to pro- 
vide for continuous progress for the student. 

s The instruction received by t he ' student 
includes essential skills and concepts and 

.higher ievel experiences *Mch bring together 
the various Skills and concepts of the curri- 
culun - area and *Mch integrate them throu^ 
other curricular areas. W>at the Student is 
to learn- is clearly defined, as are achieve- 
ment standards and expectations. The student's 
daily work is at a level of difficulty rfiich 
bdth challenges the student to learn and" grow 
and provides experiences of success and 
eonpetence in learning. There is evidence, 
that the student is using critical thinking 
skills axi independent Judgnent and has 
opportinities tri pursue educational interests. 
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Areas of investigation 
The curriculum 



GUIDE FOR COLLECTING INFORMATION ABOUT WHAT STUDENTS ARE LEARNING 
Primary jffiprce of information: 



Standards and expectations 
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classroom observation 

What skills and concepts to be Teamed have been 
identified? 

Does the range of the skills and knowledge to be 
learned mefet the needs of students? 

0 

How does the curriculum provide for experiences 
which bring together the various separate skills 
and concepts? 

What kinds of alternative a^ivities and 
approaches are available for students who have 
difficulty mastering skill* and concepts on the 
first attempt? 

How are opportunities provided for students to 
apply the skills they are learning? 

How does the curriculum 'reflect the needs and 
strengths 9f students? Are alternatives and 
accommodations available to students receiving 
special services? 

What standards and expectations. for student ;per- 
[ formance have been established? What are the 
proficiency standards? 

Are standards known to the students? To parents? 

* 

Do the standards and expectations permit each 
student to experience success? 

Is the student expected to, exhibit quality 
workmanship at a level at which he or she is 
working? 
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Verifying sources of information: 
* interviews/documents 



Explore with teasers and support 
staff : How decicions regarding 
curriculum, textbooks , ard mater- 
ials are made; how curriculum is 
modified or expanded to meet the 
needs of students receiving special 
services; how those decisions are 
made; what opportunities there are' 
to integrate various curriculum 
areas not observed in the classroom 

Explore with district staff : How 
decisions about curriculum, text- 
books, and materials are mpde; how 
the school staff is involved in 
;hese decisions 

gplore with teachers, aides, 
Support staff, and students : How 
^standards and expectations for 
|£udent8 were developed. How con- 
sistent th$y are throughout the 
school; how equitably they are 
jpplied; who is responsible for. 

jtaining standards; how and when, 
parents tere involved* 

Documents : School plan, continuum, 
all individual learning plans , 
notes home to parents, mandated 
proficiency standards, and required 
differential standards; courses of 
study, textbooks, curriculum 
materials , IEPs , ILPs , and other' 
learning plans. 
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Area of investigation 

How the curriculum is 
coordinated and articulated 
among teachers 



Critical thinking skills 
and independent judgment 



Primary sources in information* 
classroom observation 

How is the curriculum coordinated within a 
grade level? Between' grade levels? How does it 
allow continuous progress for all students? 

How do the classroom teachers and resource or 
specialist * teachers work together to ensure 
continuity of learning for , students? (Consider 
all students receiving special services— gifted 
and talented, LEP, educationally disadvantaged 
students, and students with exceptional needs.) 

To what degree are all appropriate staff 
involved in developing and reviewing individual 
learning plans (lEPs)? How are parents 
involved? 

What opportunities does the student* have * to 
make decisions and/or choices appropriate to his 
or her performance level and ability t*> 
function? 

Are there signs of leadership responsibilities, 
task responsibilit ies , and so forth? 

What kinds of activities and materials are 
there that ptovide students with opportunities 
to make* judgments and to apply higher level 
thinking skills? * 

What kinds of opportunities are there for the 
development of critical thinking and independent 
judgment for all students, including 1 LEP, 
Title 1/SGE, gifted, - and students with 
exceptional needs? 



Verifying sources of information: 
interviews/documents 

Explore with teachers and support 
staff : How the records of pupil 
jjfogress are designed, monitored, 
evaluated , articulated , and 
modified throughout the school. 



Explore with teachers, aides, 
support staff , and students : The 
ways (not easily observable in the 
classroom) in which students are 
challenged to extend their 
learning; how they are involved in 
critical thinking activities, 
decision making, leadership, 
independent judgment , and pursuit 
of their own interests 
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The statements listed below indicate actions which may have been or 
need to be taken to improve the effectiveness of your program. The 
specific opportunities select fad by the reviewers reflect their 
understanding of your program and their best suggestions for what yojr 
next steps mi^t be to make ydur program more effective for students, 



a. Develop the curriculum by adding the missing skill/and concept areas 
or by extending the range or depth to permit the Continuous progress 
of each student. 

b. Identify specific skills and concepts within the curriculum. ' 

c. Identify specific skills and concepts needed to achieve the objec- 
tives of individualized learning plans, defining academic standarrte 
and expectations. 

d. u ^J n tne identified skills and concepts in planning daily instruc- 

e. Prdvide activities for the development of critical thinking skills 
and\ndependent Judgment. % 

f. Establish coordination among classroom teachers-, at various grade 
levels/departments, 

g. Establish coordination betwetn classroom teachers and resource 
^nd/or specialist teachers. 

h. Include activities that are designed to develop and extend student 
awareness, knowledge, and appreciation of other cultures. 

i. Include in the curriculum planned activities that are designed to 
develop the personal and social skills of students. 

J. Provide opportunities for students to develop arid increase their 
skills and taowledge in many curriculum areas. 

M Integrate the skills of reading, language, and math throughout the 
curriculum areas. * 

1. Provide activities that challenge and motivate. 

m. Use school, district, SESR, consortia, county program improvement 
resources in curriculum development. - 

E/S 



WHAT STUDENTS ARE LEA WING 



sfaff, and others at the school. The SSC/SAC/BAC, along with other 
staff and parents, should review these suggestions, determine their 
potential effectiveness for program ipprovement, and then decide how 
your ongoing planning, translating and evaluation precedures will be 
used to incorporate them into your program. 



Selected Opportunities for Improving 
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THE EFFECT OF" INSTRUCTION ON STUDENTS: THE ENVIRONMENT *N WHICH LEARNING TAKES PLACE 



This criterion focuses on hpw effectively the school 
and classroom environment supports and encourages each 
8tudent 9 s academic, personal and social growth. 



What do they think about the physical arrangement 
of the classroom? What do they think about their 
school? % 



To find out how the learning environment affects the 
students, observe the**classroom environment and the activi- 
ties in the classroom. Talk to the students. Find but how 
responsible they, feel for their behavior and for the 
behavior of others. Who sets the standards of befiavior? 

V 



Observe the total school environment. See how 
the adults and the students interrelate on the 
playground and in the cafeteria* the halls, and the 
teachers' room. (Observe the physical plant f the 
playground , the of t ice , the nurse 's room, and the 
cafeteria. How \does the environment support 
student learning and growth? 



/ 
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CRITERIA FOR JUDGING QUALUJfr 
THE EFFm OBSTRUCTION ON STUDENTS: THE ENVIRON€NT IN WHICH LEARNING TAKES PLACE 



This criterion focuses on how effectively the school and cl^sroom 
environment supports and encourages each student's academic, personal 
and social growth. 



In applying this criteriW^consider: (1) Classroom environment, andfe 
(2) school environment- Be sore to include all part icipatinp students^* 
including students receiving special services (LEP, gifted arxf^B 
talented, Title I/SCE, and students with exceptional needs). 



Students in their learning settings appear 
to be bored with or hostile toward the 
learning activities in which they are engaged; 
they do not perceive school as a place to 
learn or pursue learning. The atmosphere is 
tense and there is disruptive behavior and 
fear for physical or emotional safety. 
Standards and expectations for achievement and 
behavior are generally low and erratically or 
inequitAly enforced. There is little tespect 
among or between students and sfflff; they TJo 
not expect much out of the school either for 
themselves or for Others, ~ Ethnic, social, 
economic, language, physical, and sex 
differences among' students and staff are 
ignore* and misunderstood. There is evidence 
that trie atmosphere arid physical environment 
of the classroom and school Inhibit students 1 
full participation in learning. 



Students in their learning Settings appear 
busy completing their assigned work. 
Standards jnd "expectations for achievement and 
behavior provide a ohallenge for many students 
and are generally applied in a consistent and 
equitable -manner. There is an atmosphere of 
courtesy among students and staff and of 
compliance with school rules; students have 
freedom for self-expression and for 
interaction with other students; the school 
takes sane initiative to support their 
personal and social growth. Ethnic, social, 
economic, language, physical, and sex 
differences among students and staff ^re 
recognized and understood. There is evidence 
that the atmosphere and physical environment 
of the classroom and school allow students' 
full participation in school life. 



In their learning settings, students appear to ' 
be motivated and exhibit initiative for 
learning; they perceive school as a place that 
encourages and supports self-direction in 
pursuing educational interests. The atmosphere 
yid mood are friendly and supportive of both 
academic learning and personal and 90dal 
growth; standards and expectations for 
achievement and behavior are hi(J> and 
equitably applied. There is an atmosphere 
, among students and staff of respect for self, 
for others, yid for the school; they are 
enthusiastic about -their experiences at 
school. Ethnic, social, economic , language, 
physical, and sex differences among students 
«l staff are respected and appreciated. 
There is evidence that the atmosphere and 
physical environment of the classroom and 
school enhance students 1 full participation in 
school life, ^ 



\ 



LOU 



HIGH 



SO 



11-24 



GUIDE FOR COLLECTING INFORMATION ABOUT THE .ENVIRONMENT IN V&ICH LEARNING TAKES PLACE 



Area of Investigation 

The^atmoaphere of the 

school/classroom 




81 



- Primary source of information: * 

school/classroom obser vation 

* 1 

, How do the admits work togeftheT? 

How dq the students work together? Do they 
"cooperate in carrying out group assignments? 

How do the adults at 'the* school, including 
S^cre^arialf janitorial, food services, and 
other support staff interact^yith the students? 

How do the administrators at the school interact 
with the students and under what cyijiitions? 

How are the standards f of behavior determined 
withftv.th^ classroom and Jputside - the classroom? 

If 

How are the standards applied? By whom? * *"* 

« . * \ 

Is the application of standard* eguitable? 

What kinA of activities are Jthere that support 7 
^th^* personal and social development of % the 
students? Are such activities available to all- 
stikieW*! 

How well do .students accent responsibility for 

assignments'? ;* * 

i 

What ^kln4s of * opportunities are provided ipr 
•students to' develop arid utilize their strength's, 
talents , and interests? . 

* % 

What kinds of ^elf-^ixectiv^s^ac^ivities are 
. available to students? 



Verifying sources of information: 
• interviews/document 8 



L 




Explore with all school-level 
personnel and parents" Kinds of 
school wide activities that support 
the personal and social growth of 
8 1 ude n t s ; how -de ci s io ns are made • ■ 
How the non-motivated <zhiAd is 
helped; how aides, par**tsV~ and 
other volunteers feel about their 
place in the school ; opportunities 
that are presented fgv staff to„ 
, exchange ideas^" visit each other, 
and communicate. 

Documents : Any records of student 
awards, ass.enfrlies, tutoc lists, 



classroom standards foj* behavior. 



t 
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Area of Investigation 

; The nature of the 
ptr^sical environment* 



• Primary Source of information : ^ 
school /classroom observation 

Is they physical setting conductive to each 
student^ full particiption in school life? 

How do students and" adults share responsibility 
for' their environment (bulletin boards, 
displays cleanliness of rooraw and school 
grounds; etc.)? 

Is the school an attractive, clean, and safe 
place for students to be? 



Verifying so u rces of information : 
int^| |tew8/do cument8 

Explore with teachers, aides, sup- 
port staff, administrators, and 
district personnel ; ^ How decisi ns 
about the physical plant are made 
and who is^involved; staff involved 
in maintaining the physical envi- 
ronment of the school. 
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OPPORTUNITIES FOR ItfTOVING THE ENVIROM€NT IN WHICH LEARNING TAKES PLACE 



The statements listed below Indicate actions which may have been or 
need to be taken to improve the effectiveness of your program. The 
specific opportunities selected by the reviewers reflect their 
understanding of your program anft their best suggestions for what your 
next steps micjrt be to make your program more effective for students, 



staff and others at the scfflfcl. The SSC/SAC/BAC along with other staff 
and parents should revie\these suggestions, determine their potential 
ef feet iveness* for program approvement t and then decide how your ongoing 
planning, translating and\evaluation procedures will be used to 
incorporate them into your prft Qfflfn. ^ 



a. Hfc na fl e the Instructional program in ways whitfi encouraae students 
to: 



• Be self-directing 

• Be self-checking and self -correcting 

• Hike independent choices 

• Be successful as a learner 



b. Build into the daily schedule activities whit*) encourage students to 
extend their capabilities and pursue their interests. 4 " 

c. Extend ^apgrt unities for student* to,participate in a wtae variety 



of academic and cultural activities and in activities which promote 
personal and social growth. * 



cf. Actawledge" student jeffort 
personal/ and social areas. 



and accomplishments in academic, 



e. Ari*>ge opportunities for students to work together in activities 
which ire goal-oriented and which allow them to feel pride ~ard> 
satisfaction in accomplishing the goals. 

f: Model respect for others, understanding, and Ippreciation for indi- 
vidual differences among students and staff. 

g. Create physical arrangements that reduce vi*jal or sound distrac- 
tions and provide an appropriate environment for learning. > 

h. Organize Joint student, staff, parent, and district efforts to 
provide/maintain a safe, clean, and attractive environment. 

1* Set and *)ply school wide, standards for student^ behavior. 

J. Organize the ' classrocm environment to facilitate integfation of 
individuals with exceptional needs. 



\ 



Selected Opportunities for Improving 
* 
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TtiE EFPE& OF EXqgSS-COST SERVICE 



. - This criterion focuses o*. the extent to which 
m the supplementary instructional and instructional 
Jujfport services / (Title . I/SCE) 'received by eacfc 
edacati<vtall^ disadvantaged student work together with 
the. regular program in order to accelerate student 

progress and provide for continuous progress, 

■ * * < 

In Judging ^he' effect of excese-cofet services for 
studettfs identified* as Titile/Sfli^ participants , first 
identify the students vtfhich * are' receiving these ser- 
vices.:/ Then . look . specifically ' *t those services 
supposed by. Title "I 'art/on SCE funds which ate iki 
additiqn-to thfe regular district program for all stJ- 
dents. The services may* .be provici^i by people employed- 
p6 pro vide ^ upgleaeiytaty . sefvices (e.g v , instructional 
ai^e, ^TCTOUrce teach*?/ "counselor/ oij psychologist, 
nur8e S J^** 9 ;.jqommunity ,~;aide}, Vr materiiw and 
^q^pSenj^purchiBed^.to > proifid$ alternative* learning 
4Popf>ortunXties. for ' ki&. ttfentjfcfi^ students or both. 
Review <t he. bdSge.t* ptf^e^of 'the school plan to determine 



EDUCATIONALLY DISADVANTAGED STUGENTS 



what services are beiwg purchased and the areas of the' 
program in which funds are being expended; UhenVlook 
for excess-cost services in those areas. 

To what extent do the excess-cost services work 
together with the base program in of der , to accelerate J 
» student progress and provide for continuous progress? 
Observe the educationally disadvantaged students at 
work; talk to them about their work; look at their past 
woirk. Tal)c to the classroom teacher, the aide, the 
specialist staff^about the excess cost services. How 
do these services fit in with the regular program of 
iltetcuctiori? How do those working with the student 
communicate .with each other? How well are the services 
working for The student? • . • 

•f 

Remember that th$_purpose qf excess-cost services : 
is to. supplement the regular program to compensate for 
the participants 1 16w achievement ^levels by, accelerat- 
, ing their progress. 



/ 



CRITERIA FOR JUOGING QUALITY 
WE EFFECT QF EXQ-SS-COST SERVICES ON EDUCATIONALLY DISADVANTAGED STUDENTS 



ft 



tm* criterion foc&ses on the" extent to which supplementary i^tjuc- 
h !on a^ KtrSal support (Title I/SCE) ^«*J*?. 
educationally disadvantaged - student wo* together . -1th the regu lar 
S5£»f "In 'order to accelerate student progress and provide for 
continuous progress. 



9 



Tn applying this criterion consider:. (1) All excess cost «"icfe 
£ov?S b7 Title I/SCE funds through 'all categories of expenditures, 
fncluofng "centralized ar* contracted services and ^"al outlay, 
and (2) All identified educationally di ^^^^^JV/SC? 
those in bilingual education programs f -nded through Title l/5Ct. 



The excess cost services received by the 
students are not bas*d on student needs. The 
regular instructional . program and instruc- 
tional excess cost services are separate and 
poorly coordinated, providing little 
continuity of learning for students. Student 
worfc show little or no acceleration in 
student achievement. Assessments of what 
'students have learned and have yet 1 to learn 
are not used for Joint planning by the regular 
classroon teacher and excess cost services 
staff. Lessons consist primarily of skill 
drill -1th limited opportunities for aPRlyl^ 
the *llls. Expectations for students are low. 
Excess cost instructional support services 
have had little or no effect in meeUgp the 
health and guidance r needs of students or 
providing in-service training for staff In 
meeting special needs of participants. Parents 
of participating students have little 
knowledge of their . student's school peogrsm 
end are not involved 'in- lt\ ; 



The excess cast services received by the 
students are largely based* on student needs 
althou^ assessment of student needs is rather- 
global and/or not up-to-date; they are 
supplemental to the regular program and the 

" articulation between the regular classroom 
program and the instructional excess cost 
services provides continuity of, learning for 
many, but not all, students. Stuctent wo* 
shows that there is steady progress in student 
echievawnt. Expectations for students held 
.by teaching staff generally are challenging. 
The excess cost instructional support have 

— Ren" -effective' in meeting the health and 
guidance needs of students and in providing 
in-service training for staff in meeting 
special needs of participants. *Parents of 
participating students are informed *>out 
their, student's school program, althou^ few 
ar** directly involved in the student* s 
learning. 



The excess cost services received by the 
students match student needs; the services are 
supplemental to^nd fully integrated wit/> the 
students' regular classroon program, resulting 
in a program of continuous progress for the 
students, . Student work shows that student 
, progress is accelerating. The expectations^ 
and standards 'fol^student performance held by 
both the teaming staff and the stuxfcrts* are 
hi^e Excess cost instructional support is 
effective in meeting health and guittonce needs 
of students and providing in-service training * 
for #taff In meeting special needs of 
participants. Parents of participating 
student* are knowledge*)!* *xx* their 
student's school program and ' are directly 
involved ih his or her learning. 
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guide for collecting^i Formation about excess-cost services 



Area 'of investigation 

Jhe excess-cost services 
received by the student 
4 



Primary source of information : 
observation 

What kinds of supplementary services are provi- 
ded t>y the classrodfc teacher? By the specialist 
teaAer? By the aide? 

How <|pes the aide work with the -students? 

How do the teacher and aide plan what services 
the student will receive? 

When services for Title I/SCE students are 
provided out of the classroom in a laboratory or 
resource or media center, who determines what 
those services • will be, when and for how long 
they will be provided? 

'How much time per week do tfie students spend in 
the center, and how are they rotated into and\ 
6ut of the center? 

* • * < 

What is the student miss-ing frqpa the .regular 
classroom program while he or she la receiving 
excess-coet services? f 

X • 
How does Che classroom teacher 
specialist teacher is providing? 



Verifying sources of information: 
interviews/documents " 

Explore with teachers, aides, 
support staf f , administrators » 
parents and district staff : 

The district program for all 
studemts in reading, language, 
mathematics, and multicultural 
education and the services provided 
to Title I/SCE students over and 
above the district programs how 
those services supplement district 
efforts; how all those who work 
with an individual Title I/SCE 
student share information to ensure 
a unified approach to instruction; 
how - people know whether the 
selected personnel, materials, pro- 
grams, and processes, are effctive 
in accelerating the growth of ' the 
students; how the various services 
, are integrated to provide maximum 
benefit to studenti 



know what the 



ERicy 
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How do the classroom - teacher and the specialist 
teacher work 'together to^planSJfor continuous, 
j progrestwfor the students? 

What materials/activities axe being used? Do 
they provide alternative learning opportunities 
for the students? 

# 

To what extent are the materials and activities 
appropriate to the needs of the students? 



II-JO 
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Area of Investigation 



Provision of support 
services \ 



Primary source of information : 
„ observation 

To what extent do the materials/activities 
reinforce and/or extend what is being learned in 
( the regular program? 

How responsible is the classroom teacher for the 
<otal learning experiences of the Title I/SCE 
jBtudents? 

Do the classroom teacher and the specialist 
teacher believe that the students are making 
extra progress because of the extra services? On 
what is this belief based on? 

What standards and expectations * do the 
Instructional staff hold for the educationally 
disadvantaged students? * 

What effects have the planned .staff development 
activities had in preparing staff , to- meet the 
special needs of the idei^tified students? 

How have the parents education activities and 
parent involvement in the classroom and school 
program increased parents' understanding and 
support of their children's program?' 

How have health and guidance services been used 
to meet the special needs of Title I/SCE 
students? What effect have those services had? 



Verifying sources of information; 
interviews/documents 



* 

Explore 



with Title I/SCE aide, 



resourc e teac her 

I/SCE. 



The lfoles of the 
Title I/SCE. »ide v v and resource 
teacher and withernam thejr work; 
how they know th$t what they /do 
with students makes a difference in 
their learning; when students get 
special help out of the classroom, 
who decides what they will learn 
and how tK£y will be taught? . 



Documents: Title I^fSCE student 
budget allocations and 
time account sheets; 



lists; 

printouts; 

records of student progress; lesson 

plans; aide/ teacher, classroom/- 
*eupport personnel communications; 
'standardized test data; list 

personnel by funding source 



of 



How have the Title I/SCE resources of the 
district been used to support the schbol 
program? 
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OPPORTUNITIES FOR IMPROVING THE EXCESS-COST SERVICES FOR EDUCATIONALLY DISADVANTAGED STUDENTS 



. 0 

• y 

The statements listed below Indicate actions i#iicti may have been or 
need to be tAen to improve the effectiveness' of your program. The 
specific opportunities selected by the reviewers reflect their 
un&erstandino of your program and their best suggestions fdr *«at your 
next steps m&>t be to make your progran more "effective for studfents, 



Provide staff development so that each staff membar who works 
the Educationally disadvantaged students knows: 



with 



- What the planned excess-cost services are, how the services fit 
in with the regular progran, and «hat the services are intended 
to accomplish. 

- How to work together with excess-cost services and/or regular p: 
gram staff to provide a continuous progress progran for studfer*! 



ro- 



b. 



- Hop to adqft his or her teaching skills to the specific needs of 
the educationally disadvantaged* students at the school ^ 

Allocate time for frequent Joint planning by the classroom teacher 
and excess-cost services instructional staff. 

c. wExanine excess-cost services and the regular clasaroon instructional 
■program to determine whether each one compliments and reinforces the 
"student learning occurring in the other , and make modifications 

where necessary to prdvide a pore fully integrated, continuous 
process instructional program for participating students, 

d. ferify that perfbimance expectations *?r .-participating students are 
compartole to expectations for other students. are challenging 
enough to accelerate enlevements j * 



^f^icis in terms of how and 

what students are learning, and jfpncrtle opportunities for 
improving the program. * r * % * ^ s 

f. Analyze the quality of parent participation and education excess- 
coat services for health art guidance and staff devflcpetent, and 
applicable opportunities for improving. ▼ / 

g. Provide LEP students with) excess-cost services 4ppr6priate tor 
students learning Ehglish-as-a-spcond-language and receiving 
instruction irt their primary. language. 
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staff, and Others at the school. The SSC/SAC/BAC, along wijW Other 
staff and parents, should review these suggestions, determine their 
potential effectiveness for program improveront. and then decide how 
ypur ongoing, planning, t£nslating,~ and evaluation procedures will be 
used to incorporate them into your pro-am., l< - 



f 



Selected Opportunities tor Improving 
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THE EFFECT OF BILINGUAL ^SERVICES ON LIMITED-ENGlhsH-PROPICIENT STUDENTS 

J . . ' 



This criterion focuses on the extent to which the 
limited-English-prof icient students , are- acquiring the 
language skills needed . for academic achievement in an 
environment which promotes the students' self-respect and 
cross cultural understandings,' - ' »• 

Use this section to judge the effect f o{' the bilingual 
services on LEP students in schools that have^| or more 
LEP students being- served through: 

• An (a), (b), or (c) (Innovative) program at any 
* grade levels K-6 , 

] 

• A (d) program at any grade ljjvel 7-12 

• An (e) or (f) ig4ivi4ual 



When applying this c 
consider all LEP students 
through the planned urogram'. 5 




ing program, K-12 

fco ' a school program, 
b i 1 i ng ua, l^se rv ^ c e 8 



The procedures for revTewir^ bilingual program ser- 
vices are identical % to the procedures outlined previously 
for students in any program: (J^ Observe students' and 
staff during instruction, (2) veview records of student 
performance and/or program planning and opecat^ion, ajid 
(3) interview students, parents, and staff. 4 



/ . 

Find out what students are doing, how 'they feel 
about their program and their progress, if they know 
what £o do next or how to find what they do not know. 

Observe the students at work; fi>nd out how their 
day i<* organized; look at their -current and past 'work; 
observe what materials are being used and what materials 
are available. Watch how they relate , with other 
students an staff. Notice how,,when, and with whom they 
use their prima rv language. Talk to the students about 
what they are doing. Talk to the teacher and aide about 
how they work with thei students; how the? know what 
students, already knctok are skilled at, and need to learn' 
in botfy languages. ™ the bilingual program; how they 
feel about prograa operation and pupil progress in the 
primary language and English. Find Out % what their 
expectations are for the iLEP pupils in content instruc- 
tion and in Engligh-as-a-secfend-lai^uage. Explore with 
thtm the ideas of identification, diagn6sia, reclassifi- 
cation, and language designation for basic skills or 
content instruction. In (a), (b), or (c) programs,, 
observe the f luent-English-prof icieht and/or English- 
only participants as *#ell. Find out how tKey aye 
learning English, and how they participate in activities 
involving the primary language and/or culture of the LEP 
pupils. 



CRITERIA FOR JUDGING QUALITY 
THE EFFECT CF BILINGUAL SERVICES ON LIMITED -ENGL ISH-PROFICIENT STUOENTS 



This criterioo focuses on the extent to wlich the limited-Engllsh- 
profident stucfents are acquiring the language skills needed for 
academic .achievement' in an environment whirh promotes the students' 
self-respect and cross cult oral understandings. 



In applying this criterion consider the effect of the bilingual 
services on all LEP students In an (a), (b), (c), or (f) program (K-6) 
or a (d) anJToT (e) program (7-12) when there are 21 or more LEP 
students. 



The LEP students are making limited progress 
# in developing the skills of understanding, 
speaking, reading, and writing in English. 
Instruction in English-as-a-second-language 
tends to be sporatic and content instruction' 
In English seldon is adjusted to the students' 
ability 'to comprehend. The students' language , 
strengths in English and the primary language 
are -assessed infrequently. Student work 
indicates tl>at the majority of LEP stucfents 
are making limited prdgress in acquiring 
skills and taowledge In other areas of the 
curriculxln. The materials being used 
frequently are in^propriate to the language 
skills and learning needs of the student. 
"Crass Ajltural activities are few and limited 
in scope. The LEP* students tend^to iplate 
themselves from other students on campus. 



The* LEP students are making reasonable 
prdgress in developing English language skills 
of understanding, speaking, reading, and 
writing;- their work also Indicates steady % 
progress in the* acquisition of skill* and 
trowledge ih other areas of the curriculum. 
The Instructional activities .in whic^ many 
students are engaged, as well as the materials 
being used, match the assessment of the 
students' . language strengths;, for other 
students, however, the instructional 
activities - and materials are ' nol fully 
ccmpat ib le with the ir current language 
strengths. Qenerally, students feel positive 
about themselves and their second language 
learning, and they are developing taowledge 
understanding of the cultures of the 
various languages -at the school. 



The LEP students are making .exceptional 
progress in developing the skills of under- 
standing, speaking, reading, and writing in 
English, Their work indicates that they also 
are making rapid progress In the acquisition 
of skills and trowledge in Other areas of the 
curriculum. Instruction is continuously 
acfepted to' each student's ability to conpre- 

. hend. It Is evident thft each student's pro- 
gram *s designed in response to bdt'h initial 
and ongoing assessment of his or her language 

.strengths in English and the primary lafhguade. 
The adults- working with the students . use a 
variety of materials and teaching strategies 
to provi&e successful learning experiences for 
eac* student in both English and the student's 
prirary language. Students are enthusiastic 
*out learning In a second* language and the 
primary language(s) of the students ;is used 
fteely In the school by students as well as 
by adults. Students' ^tAtudes toward 
themselves are positive; they are proud of 
their cultural heritage and participate 
readily - in cross cultural activities with 
other students and the 'adults at the school. 
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GUIDE FOR COLLECTING INFORMATION ABOUT THE EFFECT OF BILINGUAL SERVICES ON LEP STUDENTS 



"Area of ^Investigation 



Primary Source of Information 
Observation 



Verifying gources of Information - 
\ interviews/documents"^ 



Student progress 



How was the initial assessment of the 
language strengths of the LEP and FEP 
Student (in an (a), (b), (c)* class- 
rooms) conducted^ Who did* it? 

What did the assessment include? 
understanding, . speaking, reading 4 and 
writing in- both English arid the 
student's primary language? 



Explore with bilingual staff ; How the 
initial assessment was conducted and 
by whom, what was included; how the 
information was shared with others; 
how ongoing assessment is conducted 
and how frequently; how -the data are 
used in the design of, the student's 
program. 

1 
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How was the assessment data" used in 
the design of the student's 
instructional program? 

How frequently are assessments made of 
the student's language strengths? How 
is it done? By vhom? 



Documents : Assessment Instruments , 
student records, lesson plans. 
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Hoy are assessment data used to adjust 
the amount of instruction the LEP 
student receives in English? 

What curricular areas are being taught 
in the student 's primary language? 
.What in English? How does thi* match 

the student f s, diagnostic assessment? 

"""^ * > 

Does the language used in instruction * 
correspond to the student's language 
strengths? 



What afre the students learning itt teach 
language? ' What kjinf of academic 
progress are they making? 



Explore with Trilingual staff : What 
curricular* axe as are included in the 
student 's " program ip English an! the 
primary language ; how the la rig u ages 
are used by the adults in the' class- 
room; who decides what materials, v^ll 
be used and what * basic and supple- 
mentary materials are supplied by the 
district. 
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Area of Investigation 
The students 9 Instructional progr 



103 ( 



Primary source of Information ; 
Observation 

How are the two languages used ' in 
managlhg the classroom, giving direc- 
tions to students , answering student 
questions? \ 

During the instruction how are the two 
languages used? 

• 

How are the language skills r of the 
bilingual staff being used? , 
* 

What Is the breadth and variety of the 
materials In the students prlofcary 
language? 

In what ways are the materials the 
student Is using match to his or her 
language strengths? 

How is the time' scheduled for English 
and primary language Instruction? For 
|*EP students? 

How Is the student's instructional 

Jrogiam adj ust ed to his or her 
ncreasing development 1 of English 
anguage skills? 

What kinds of instructional techniques 
are 'used in second language 
Instruction? - functional/communica- 
tive, grammar-based , both? 

How Is cop tent instruction in English 
adapted to the student's* level of 
comprehension? By teacher -language, 
body language, gestures, by 
appropriate reading materials, use of 
concrete materials or referents? 



Verifying Sources of Information : 
■ interviews/documents . ] 

Explore -with blUggual staff: How the 
student's schedule Is determined and 
how students are grouped for 
Instruction; what , kinfs of teaching 
methodologies are used; the criteria 
for reading in a second language; the 
reclassification criteria standards 
and procedures, how the staff 
participates in reclassification, and 
how many students* have been reclaisl* 
fied. * ' 

' J \ • 



Documents : 

Student records, lesson plans, aide's 
schedule, ♦ criteria for reading 
placement, and declassification. * 
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Primary source of Information : 
Observation 



Verifying Sources of Information ; 
interviews/documents — 



Are LEP students grouped for ESL and 
content \ instruction in English 
according to their t comprehension 
levels? 



A>re the criteria 
of reading in 
appropriate? 
applied? 



for the introduction 
a second language 
Are they consistently 



Do- the teachers know the district's 
. reclassification criteria , standards , 
and procedures? 



How do the bilingual teacher and/or 
aide work with students? 



1 



What effect have the planned staff » 
development actlvftiee - had in 
increasing the bilingual * education 
skills of the teacher and the aide? 

In what way have the staff development Documents : Certificates, waivers 
activities been based on the staff development records* 
individual skills needed of the 

teachers* and aides? ' / 



How has the primary language of • the 
L£P students "been ' used in st^ff 
development activities? 

How effective da4e staff believe the 
staff development • activities have 
been?- 
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Area frf Investigation * 

Self-concept and cprosscuUtupl 
\ activities i » 

' " /. 

/ 
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f Primary Source of 'Information * 
r Observation 

What kinds., of opportunities for 
success do students experience? Whit 
kinds of positive reinforcement do 
they receive? 

^» 

. How is the primary language 
student 8 used outside of the 
rpootf -'on the playground/ campus, 
cafeteria, the faculty room, ' 

. office and by. whom? 

What kinds of crosscultural- activities 
arl there? How frequent are they\and 
who participates? 




Verifying Sources, of Information « 
~~ interviews/do cuments 

Explore with bilingual staff t . How 
bilingual staff members ^re trained 
and what fn-service training is being 
provided; who decided what in-service 
was "needed and how helpful they were; 
the processes that are underway to 
provide Staff communication .between 
the bilingual and other staff. . 

Discuss* with other staff : What they 
kJISw abbut the bilingual services 
being , provi ded ; in whs* ways LEP/FEP 
students fromta), (b) t (c) classrooms 
are Integrated with the vesrfbf the 
students. , . , 

Explore with bilingual staff ! The i r, 
techniques for reinforcing learning , 
developing positive self concepts; the 
kinds of cross cultural activities 
staderits have been involved in how 
.effective they wetjp and how frequently 
held.* ' 
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GP FOR UNITIES FOR ^PROVING THE EFFECT y BILINGUAL SERVICES ON LIMITED-ENDLISH-PROFICIENT STUDENTS 



The statements listed below Indicate actions which ffiy have been or 
need to-be taken to Improve the effectiveness of your program. The 
specific opportunities selected t>y the reviewers reflect their 
understanding of your program and their best suggestions/ for what your 
next steps might be to make your program more effective for students, 



a. Assess on an ongoing basis each student's skills in comprehereion, 
speaking, reading, and writing in English and his or her primary 
language and modify his or her program to utilize those strengths. 

b. Ensure tat materials in the primary language of the LEP student are 
avail*>le for at least every curricular area tau^it in the student's 
primary language. 

C. Provide in<he primary language of the LEP student, instruction for 
the /FEP/English-only studfents in (a), (b), (c) classrocms and 
promote language acquisition rather than learning. * 

Ensure that the criteria for introduction of reading in the second 
language include both minimal Engldsh proficiency and primary 
language levels and are consistenly used. 

Ensure .that the reclassification criteria are consistently applied. 

Analyze the manner in which languages are used for irftruction. 

Examine the extent to which lessons in English are camprehereib-le 
to LEP stu<ferts and modify instruction accordingly. 

h. Encourage use of the student's primary language outside the 
p classroan and Jn extracurricular activities., 

i. Utilize the culture of the LEP students and cultural resources of 
the LEP cam*#ity in multicultural and cross, cultural activities. 

J. Mate assignments of bilingual staff so as to make optimum use of 
their language strengths. 

k. Provide staff development for the monolingual English staff in ESL 
instruction. 

1. Assess the language skills of the bilingual aides. 

m. Provide staff development in the language skills necessary to 
ina^uct in and model both languages of the bilingual progran. ' 

n. Provide staff development for teachers and aides to increase their 
skills In bilingual teaching methodologies. 

o. Provide encouragement and support for teachers working toward a 
bilingual certificate. 



E/S 



staff, and others at the school. The SSC/SAC/BAC,, along with other 
staff and parents, should review these suggestions, deteimine <heir 
8 potential effectiveness for prooram improvement, and then decide^how 
your ongoing planning, translating, and evaluation procedures will be 
used to incorporate them into your program. C 

* • m 

Selected Opportunities for Improving ~ 
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* ^ THE EFFECT 0* INSTRUCTION AND SEJtVICEjS ON THE STUDENT. WITH EXCEPTIONAL NEEDS 




This, criterion focuses on the extent to, which 
'instruction end services provided each student with 
exceptional needs are enabling him or her to make 
• tfeady progress, toward achievement of his or her 
education- and social* goals with optimum partici- 
pation In the total school program. * 
« 

To understand how Instruction- and services 
lapact on the student with exceptional needs, you, 
as ^ reviewer, should concentrate ^primarily on .the 
total prograa of a saaple of individual students. 
You will .hate to synthesize Information learned froa 
both * reg ular a nd special education personnel, as 
well as -^Starvations of the student In regular and 
special settings; This synthesis will Involve the 
entire review team. 

» 

After developing a good understanding of the 
* total prograa of a saaple of students, focus on how 
services and Instruction froa various sources Inter- 
act tb form the whole. • . 

a 

. In order to understand how the school supports 
the student with exceptional needs, the, reviewer 
should talk to the people who are Involved *ln the 
referral -assessaent-IEP process., In aost cases this 
will include the resource*speclallst and the tfincl- 
pal,Nwho can identify fyps'essmerv£\ and IEP members. 

Examining thf process will give yoy as Reviewer 
a basic understanding of the flow of events that 
results In the dell^ry o{ services to the student. 
Try to relate what you have seen In various settings 
to the information yeu received froa adults wh^are 
Involved in' the prograa. You should eaphaslze 
. relating the Information froa adults to the prograa 
that Is received by the student. 



in 



Question the school staff, district- support 
staff, 'the Special Education- Service Region (SESR) 
.support staff, the parents and students in order to 
develop ^ coaplete picture of the bpeclal education 
students i,n all possible set lings: the regular— 
classrooB, the ' school grounds! the* cafeteria, as 
well as the settings where special education 
services are delivered. ~ 

Once the process, of how and what services are 
delivered to the students' Is understood, you can 
determine^ 

e How the special education instruction and 

servlees^Snd the regular prograa Interrelate 
e How adults cooperate in coordinating these ser- 
vices tend programs * * 
e How the tiae allocations and schedules are " 
determined 

e How the staff is supported in integrating • 
special education students into the c'lassrdoa/ 
school environment 



Determine the 'quality Diot quantity) of the 
contribution Bade by special education services, and 
the quality of the regular education contribution 
(including compensatory education, J>i Ungual 
services, Miller-Unruh,, etc., along with the b#se 
prograa). Since this criterion calls for Judging 
the effect of instruction on students, it resembles 
and parallels the other instruction criteria, 
especially "How Students jre Learning", and "The 
Environment In 'Which Learning Takes Place". This 
criterion differs primarily in Its focus on special 
education* students. Much of what* is done, for the 
"How" and "Environment" will be useful for applying 
this criterion. 
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CRITERIA FOR JUDGING 'QUALITY 
TVC EFFECT OF I«TRUCTION ANO SERVICES ON T>€ STUOENTS WITH EXCEPTIONAL rCEDS 



This criterion focuses on the ex*nt to *ich th^full ■ currleul^ ja art 
Aher instructional art related services received** the student will 
Suit in hiVor her acquisition of the skills and knowledge necessary 
•for success in later grade levels. 



Wv this criterion when sqecial education services are of/errt. 
Conifer eacti studfent on an* IEP including those ia special day 
• classes. * * * 



Tt»« activities in which the student with 
exceptional needs is engaged seldan match his 
or her/individual needs, strengths, or ways of 
learning. His or her activities are incon- 
sistent with the IEP goals and objectives and 
student' work indicates little process in 
meting these goals. The student's total 
education (rogrm is fragmented) trtre is 
little or no cowaunication or collaboration 
Along the sUff .who work with the studfent. 
Services are duplicated or conflict with other 
instructional progrTO, frequently disfupting 
the studenfs school day 'md he or she is 
waking little process in th^ re^jlar curri- 
culum. The student is rarely included even 
whan *>propriate, when % decisions are maite 
affecting his* or her educational anf social 
• yowth. The student and Others lack knowledge 
of or have inappropriate attitude, toward the 
hand leaping condition and staff, <*her stu- 
dents, parents, «* t community mjmbers are 
reluctant to accapt, and to extend oppor- 
tunities for participation t^ students with 
special need*. » 



The student with exceptional needs is 
participating in activities wMch generally 
retch his or her Individual needs, strengths 
and ways of learning. The activities are 
consistent with the goals and objectives of 
the IEP and student work,indicates T* ogress in 
meeting those goals. while there are 
opportunities for the student to participate 
in the total school program, sometimes the 
environment and/or-the instructional materials 
vti activities are not of sufficient range or 
flexibility to allow full participation. The 
student 1 ^ .instructional progrwi and related 
services are 4 being coordinated by the special 
education and other instructional staff and he 
or she is making progress in the regular 
curriculum. * The student participates, as 
*>propriate, in decisions *>out his or her 
education. He or she demonstrates knowledge 
tf>out the handicapping condition and has an 
> accepting attitude toward self and others. 



U3 



The student with exceptional needs ts engaged . 
in activities that are specifically matched to* 
his or her individual needs, strengths, and 
ways of learning. Student work indicftes 
steady progress toward achievement of the 
acadsnicT social, vocational, and *<*her gqils 
art objectives as outlined in the IEP and in 
the regula'r curriculum. 'Materials,' activities, 
environment of the claSs/schooi are 
edited to en*>le optimum participation in the 
total school program.* Communication, colla- 
boration ami mutual support between special 
education and other instructional staff *>out 
the student's instructional progr«ja ensure 
-consistent reinforcement and follow-up of 
services provided the student, whfther in the 
regular classroom or spacial education set- 
ting. The student is involved to 'the maximum 
extent ^propriate in decisions which affect 
his V her educational and social *owth. He 
or she" has sufficient knowledge of and 4 an 
accepting attitudte- toward his or her 'handi- 
cap ing condition, as have staff, rther 
students, parents, and community mambens f 
is well acceded by his or her peers. 
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Area of investigation 

Activities in which 
the student is 
participating 



Studant progress 



GUIDE FOR COLLECTING INPORMAtlON ABOUT INSTRUCTION 
POR STUDENTS WITH EXCEPTIONAL NEEDS 

Primary soutgerof information: 
observation 

To what extent is ' each student developing* 
skills in identified areas of need? 

Are students invtflv&d in activities which build 
on existing individual strengths? ^ 

How. do activities match identified student 
^eeds> * * 

j • * / 

Are activities designed to provide student 
success? ( 

Do activities provide sufficient challenge to 

• each student? Are expectations appropriate to 
individual skills .and abilities? 

instruction varied to include individual . 
small group and large group settings (as 
appropriate to the instructional activity and 
student needs )1 

Are activities designed and materials organized 
and. located to increase the student's ability 
to work independently? In small, groups? In 
large groups? 

Are activities designed to match the student's 
learning style? * 

Tl£w is ■ student p?ogrc£s monitored and 

* evaluated? Is progress* in the regular program 
monitored , in a similar manner? 



AND SERVICES 



Verifying sources of i nformation ; 



injc 

interyle ws /doc u aept s 



JLor ej with * Students, regular 
K>m t earners, » resource 
>specfalt^. special education 
parents, socialists providing 
designated services, special class 
teaehers, district curriculum 
specialist, prbkram specialist, 
aides, * principals, * any persona 
designated' by One principal' or 
resource * specialists as being 
involved in prov^dingXservices* to 
students* 



Documents ; IEPs, teacher > pjan 
hooks, assessment results, records 
of • tflS specialists, student 
progress reports , home/school 
^communication .about student work, 
curriculum materials, proficiency 
standards, evaluation. 
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• * 

. Prf ary source of infor»ation : * Verifying sources of Information: < j. 

- — jrr — - — rr— *= interviews /documents . , 

Area of Investigation Observation. * . 

What are the procedures for- making changes to ^ 

v the student's program? Are they known to all 

who work with the student? How flexible are , 
. ' (■ ' ' ' these procedures? . 

How are students involved in monitoring their 

own progress? • -» f 

Adaptatisfcis for an ftow is the IEP used- as a tool to manage and 

integrated educational measure student progress? 

pr ojrran * 

. Are new BP goals and objectives written as - 

soon as stated objectives are achieved? 
• * • * ' / . 

If stated objective? are not achieved as * 
expected, ■ what alternative thethtfds are 
initiated? 

Are the student's specific identified needs" 
addressed by the curricular areas, being 
covered? . 4t 

— Dt>m the curriculum also include those areas 
\ addressed * for regular students as much as 
appropriate, e.g., literature, multicultural, - 
etc.? 

* * - How does the curriculum accommodate differing 

learning rates and styles? 

* * « 

How, has the mode of presentation for the ^ 
\ curriculum been adapted as needed to meet the 118 

V special needs of each student,, , i.e., 

, 1 17 transcribed, Brailled, taped, etc.? Have the 

aaterlsls been adapted accordingly? 

^ Is supplementary explanation or interpretation „• 

or curriculum provided foe students? » 
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Area of Investigation 



/ 



Primary sourcfe of Information: 
observation 



Are teaching methods and strategies adjusted in 

the student's handicapping 



consideration > of 
condition?- 



Verifying sources of information: 
interviews/ documents 



Are adjustments made in curriculum; , materials, 
environment, and teaching strategies according 
to student progress? 

How are materlals^Niedla, and equipment usage 
ift all settings adapted to the needs of the 
student, to the curriculum being taught, and to 
the goals and objectives l/i the IEP? 

How are the time allotments and schedules 
-geared to the needs of the child? How flexible 
are . the s£hodl*and the special services to the 
needs of individual students? 

♦Secondary 

What provisions for counseling are included in 
the IEP? Are they being Implemented? How is 
vocational counseling being provided? Is It 
related to the career/vocational assessment? 



Least restrictive 
environment 



ERIC . * 
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Are Instruction and services, provided »J.n the 
least restrictive environment? 

What 'opportunities does the student l\ave to 
learn and practice* skills and behaviors which 
will Increase Integration opportunities? 

What is the range of opportunities considered 
for a itudent; m to participate in * regular 
programs and activities? 

What assistance A provided, If, needed, to 
facilitate participation in regular program and 
act Ivlt les , i.e., Interpreter for ~7feaf , aide 
for physically handicapped, etc.? 
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^ %t Primary source of Information: Verifying sources of Information 

Art* of Investigation . Observation ~ Interview/ documents 

Are^tltere specific ^rtlvitlee to Enhance the 
positive* attitude of , staff, 'parents, and - 

students tpward students with special needs? 

■» • • 

Attitudes of staff and Are all students considered when planning 

* students school activities? , * * 

In what ways -do students participate In \ ^ r 
, , % decisions made which affect xheir educational * ( 

# and social growth (attend IEP meetings, 

parent-teacher conferences,, etc**)? 

How accepting of special education students are • 
the regular teaching staff, support* staff ? 
Students? 

* • -\~ • » • * t . *What are special education students called ato a 9 

w group? 

Does the classroom environment include sppce 



lent lnciuc 

for *in<iividuab, small group, and iirge group 
activities? 

: Is the space where services are provided ^» 
appropriate and sufficient for the number of*^ <fe * 

students? / " 

Where are special education ffervicea prodded ^ 
at the schooi? Does their location promote the . * 
integration of special education students into y B 

regular school activities? 



For students in special day .classes, . who 

m decides where the £**|ents will, be placed 
during integration into The regular program? 
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How are students with exceptional needs treated 
on the, school grounds at recefs? Befor^ and 
after school? 



9 
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' Prlpary source of information; Verifying sources of .Information: « 

Area of Investigation observation : Interviews/documents 

Coordination of Whit kinds of reinforcement + and follow-up 

services special Instruction and services does the 

student receive In all other settings, l.e.,~ ^ 
language .arts/speech therapy, reading/ phonics, 
resource specially:, physical education/ 
mobility Instruction? Are they consistent? 

Row frequently does the student .receive 
frequent feedback from those persons directly 

Involved? % ' 

What provisions have been made for ongoing 
staff development activities In special educa- 
tion dor regular staff, administrators, special 
education staff, support staff, parents? * 

How are regular staff provided with ongoing 
assistance with Integrating, and coordinating 
the program of students with exceptional needs 
In their classroom? Is this ~ assistance 

ongoing? m -> 

How do the regular and special education staff" 
communicate and coordinate the student's pro- 
. gram (written progress updates, frequent meet- 

^* logs, scheduled consultation periods, etc.)? * 

What kinds of follow-up to services received In ^ ^ 

the regular classroom or the special education 
setting Is provided for the student? 



ERJC^ > 
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OPPORTUNITIES fFOR IMPROVING THE EFFECT OF I*6TRUCTI0N AND SERVICES CW STUOtNTS WITH EXCEPTIONAL >€EDS 



The stat ©rents listed below Indicate actions which may have been or 
need to be taken to improve the effectiveness of, your program. The 
specific opportunities selected by the reviewers reflect their 
understating of your program and their best suggestions for wbat your 
next steps mitfit t)e to make your program more effective for students, 



a..Pl*i end provide sequential activities for the achievement of goals 
*vj objectives'in the student's IEP. 

b J Develop -an ongoing system tc*Mw>>ltor 'student progress in achieving 
\ goals and objectives In. the IEP as well in the regular program as 
'indicated. 



c. Provide artivlties which challenge the student and 
adequate rate of success. ^ 

d. Expend the range (^resources,, materials, and envir 
are available to. students with exceptional needs. 



afford an 



>lch 




e. Adapt curricula, teaching methods, and learning enviroonenflp to meet 
individual student needs. 

* f. EstAllsh * system, foimal or Infoimal, for sharing infdpnetion 
. about the student between all persons who work with him or her. 

g. Involve each student as appropriate It decision-making regarding his 
or her educational and social growth. 

h. Provida exceptional studants with appropriate information regarding 
their individual disabilities as well as abilities. 

1. Involve, staff,, parents, and regular students in staff development 
and Othef activities wMct> promote </Kferst ending and acceptance or 
Students with exceptional needs. 

j'. Provide staff development and ongoing support for -regoUr clas^ocm 
teedwrs In integrating and coordinating the program of the stucfents 
with exceptional needs In their classrooms. 



staff and others-at the school. The SSC/SAt/BAC along w$h ctfier staff 
crt parents should review these suggestions, determine their potential 
effectiveness for program improvement, and then dec i* how your ongoing 
planning, translating, and evaluation procedures will be used to 
incorporate them into your program, 



Selected Opportunities for Improving 
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THE JSFFECT OF INSTRUCTION 'ON STUDENTS:, 

This criterion focuses on the extent to- which' 
the full curriculum and x other instructional and 
related services received by the student will result 
In his or he* acquisition of the skiLls artd 
knowledge necessary for success 0 in later grade 
levels. 

* * # . 

While developing an understanding of what 
students are learning in each currigular, area and 
the kinds of special, instructional and related 
services they are receiving, reviewers also should 
be analysing ' how the program as a whole cones 
together for the Individual student. Judgments 
about the student's total program are based 
primarily on four understandings. 

• What the district and school have defined 
as the skills and knowledge students are 

* expected to learn through the school cur- 
V riculu«r * \ 

e The curriculum actually experienced by l the 
s selected sample df students t including* 
past. and planned studies 

• The special instructional and related ser- 
* vices received by the students^ 

• The relationships between the special 
services received, the curriculum .Experi- 
enced, and What the student is expected to 
-learn 

To understand what the district and school 

expect students to learn, revi£w*is should rely 

primarily on interviews. Be alert Co changes in 




127 

V 



i 

THE EFFECT OF THE TOTAL PROGRAM ON THE STUDENT 

expectations or loss of 'clarity from 2he district 
and schoolwide definition of skills andr knowledge to 
the expectations expressed in work assignments and 
the feedback given to students about their learning 
(or lack of it) . 

To understand the curriculum actually 
experienced by each student in the sample, reviewers 
should Vely primarily on student, teacher, and 
specialist teacher interviews and student work. ' 

Do the students and teachers understand what 
specific skills and knowledge the students -ate* 
expected to learn? Are the expected learnings 
comprehensive? Does the instruction provide for. 
learning what is expected? . Is the student 
acquiring the expected skills and knowledge? Is the 
student extending and applying what is learned? Is 
the student taught how to put it together? Are the 
special instructional and related services helping 
the student learn what he or she is expected to 
learn? s 

The curriculum* as it is experienced by spclal 
education students may be quite different from the 
curriculum presented to other students. The IEFs 
for special education students should provide 1 a 
basis for evaluating the effect of .instruction on 
each student. Becaase standards and expectations 
may be different, some of the questions on the 
following guide for collecting information may not 
apply. 
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CRITERIA FOR JUDGING QUALITY . 
THE EFFECT 8F THE TOT*. PROOWM ON THE STUCBO 



This criterion fecuees on the extent tp «hlch the full curriculum and 
other inetructlonal and related services received by the student will 
% result In his ox hsr acquisition of the skills end knowledge necessary 
* tar success In later grade levels. , ■ 



In spplylng this criterion consider: (1) the totel curricula received 
by the stucfent and (2> all special Instructional and related services. 



The total Instructional prognm -experienced 
by the student is limited, offering fee 
opportunities to develop skills and lexjwledge 
in currlculua areaa other than, the basic 
skills. Instruction received by the stud** 
tends to be ftegpe nt od, and provides little 
opportunity fbr ^plication of whet is being 
learned. The student receiving special 
instructional and related, services (coMpense? 
tory 9 bilingual and/or special education), 
fluently' Is pulled but of the classroom and 
has little or no time to learft wfte» wee missed 
during those Usances. There is little or no 
relet Iqmhlp between the student's regular 
program of instruction and the special servi- 
ces provided out of the classroom; the. class- 
room teecher(s) and specialist staff design 
learning activities for the student indep- 
endently of etch other. Little effort is 
being mede to help the student beceme 
responsible fbr his or her o*n learning or to 
prepare him or her to succeed in later grade 
levels. 
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The totej instructional program experienced by 
the student provides e vtilety of opportuni- 
ties fbr the development of* skills and to** 1 * 
ledge In the be sic skills with opportunities 
tp apply those"*kllls in other areas Qf the 
currlculua such as, social studies, multi- 
cultural education, science arid the floe arts. 
However, the time allowed for other learning 
skills and concepts In curricular areas is 
limited. The classroom teacher(s) and 
speclellet steff ere attempting to coordinate 
the total program of instruction for the 
student receiving special instructional and 
related services (compensetory, blllngusl 
end/or special educetlon) so that the studert 
(fces"~fWy miss major sepaents of regular 
classroom f net nict ion then he or she is pulled 
out of the classroom to receive special 
*rvlces. Infepaation dbdut the student's 
progress is shared between most classroom 
teechers, end the specielist steff; In sore 
Instances, the student's teecffer(s) end 
spocijftlst steff - Jointly plan his or her 
learnjhg activitlea. Efforts are being mede 
to 15re|pera the student to be successful in 
later grade levels end, to some extent, to 
become responsible fbr his or her owi 
learning. ' 



f 1 



( The totel instructional prognm experienced by 
the student provides e wide veriety of oppor- 
tunities fer the development of skills end 
knowledge In all currlculua arees of the 
- school program as well aa opportunities to 
pursue his or her educational Interests. The 
student's corvmand of the basic skills en*les 
him or hsr to develop end 1 express new know- 
lodge end undent endings in ehe fine erts, 
social, natural and physical sciences and the 
other areas of th* curricula The stwAnt 
receiving special instructional and related 
?r services (ccm0rfneatory, k bilingual end/or 
special educetlon) in edditlon to the reguler 
program is experiencing e cortinulty of * 
leerning ectivities which build on his or her 
strengths *ile\ effectively helping the 
student overcome W eccommodete his or her 
special >needs. ' The study's leerning 
* activities ere besed on continuing assessment 
of his or her needs' end strengths end ere 
designed Jointly by the regulay classroom 
tedbher(s) end the spocloitet- / steff; com- 
munication end collaboration « *ohg the stu- 
dent's teecfter,(s* end spectelUt steff is 
ongoing end timely. It is clear {hat* the 
studsnt's instructional program is. preparing ^30 
hi^or her to be e self responsible learner 
-jKtt to be successful i<i later gradevyrvels. 



\ 
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GUIDE FOR COLLECTING INFORMATION ABOUT THE EFFECT OF THE TOTAL PROGRAM ON fHE STUDENT 



Area of Investigation 

The curricula received 
by the 'Student 



Primary source of Information: 
observation 



Verifying sdurcgf of Information: 
interviews/documents » ~~ 



What curriculum Areas are Included In the Explore wl th teachers : 
student's total Instructional program? What 
Curriculum priorities does the total Instruc- 
tional program reflect? 

To what extent Is what students are to learn In 
each currlcular area clearly defined? 



The 



Is that definition consistent 
between the grade levels? 



within 



and 



How does the Ins t ruct ional program al low 
students to pursue their educational Interests? 
In the classroom, the school, the community? 

Is allowed for^nstructlon In the 
In other areas of the curriculum? 



w much time 
s icT skill? 



In what ways are other currlcular activities 
(e.g., art, social studies, music, .etc.) Inte- 
grated into the total instructional program? 

What opportunities do students have to apply 
basic skills* in other currlcular areas? 



currlcular areas that are Included 
in the total program; what is 
covered and how; the amount of time 
thst is allocated for learning, in 
each area; how the currlcular areas 
are Integrated Into an instruc- 
tional whole for the students. 



Documents : The schdol plan, 

courses of study, texts and 
supplementary materials available 
in classrooms, resource centers, 
library/media room. Student 
records. Teacher lesson plant 



ns. 



Coordinating the 
student's instructional' 
program 
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What kinds of special Instructional and related 
services are the students receiving? Who Is 
providing them? Where are they being provided? 

Who determines what kinds, of services are 
needed? 

Who determines what the>^ student* s learning 

activities will be in the special instructional 
setting? 
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Explore with teachers, specialist 
staff, aides ? The kinds of special 
instructional and related services 
received by the students: vwhen, 
where, and by whom; methods of 
communication and collaboration 
between teacher/specialist staff; 
follow-up activities, • 
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Area Of Investigation 




Student responsibility 
for learning and 
preparation for later 
grade levels 
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Primary source of Information: 
' " observation — ~ 

What^CTnds of assessment and student progress 
Information Is exchanged between the classroom 
teacher and specialist staff? How frequently 
Is It exchanged? 



at kinds of follow-up activities 
in: the regular classroom? ^ # In t 
setting? 

W frequently Is the student pulled 
classroom to receive special servlc 



What learning- activities does he or she miss 
while "out of the classroom? Does he or she 
learn the^Ln the special setting? If not, 
when does tne student have the opportunities to 
learn what he or she missed?' 

Does the student complete his or her assign- 
ments with the prescribed time? If not, what- 
happens? 

Does the student correct his or here own work? 
If homework Is prescribed, when Is It returned 
to the student? Does he or she correct any 
errors made? 

Does the student's work reflect standards for 
quality? 

Does the student have opportunities to select 
activities? To work Independently? / 

m 

Is the student prepared academically and 
personally to- succeed In the next grade level? 

If the student Is going to a grade level or 
school with different organisational patterns 
(e.g., team teaching, departmentalized), how is* 
he or she prepared to work in that different 
setting? • > 

II-l 



Verifying, sources of Information: 
interviews/documents ~~ 

Documents : IEP, I LP, student work/ 
records,, written Communication 
between teachers lind specialist 
staff, lessoty plans* 



Explore with teacher,, aides, 
specialist staff : How the staff 
works to help the student Become 
responsible for his or her learning 
and how they help prepare him or 
her for success in later grade 
levels; Is there articulation 
between the elementary .school and 
the middle or junior high school? 
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OPPORTUNITIES FOR IKfTOVING THE EFFECT OF THE TOTAL PROGR/W ON THE STUDENT 



The statements listed tJelo* indicate actions whirf> may have been* or 
need to be. taken to improve the effectiveness of your program. 4 The 
specific, opportunities selected by the reviewers reflect their 
understanding of your program and their -best suggestions for what your 
'next steps mlfrt be to make your program more effective for students, 



a. Extend the student's 
ties to develop skills 
natural, and physical 
* as in the basic skills of 




lun so that each student has opportmi- 
know ledge In the fine arts, social, 
and other currlcular areas as well 
, reading, and mathematics. 



b* Explore ways .of providing more time for student* to develop skills 
and, loiowledge In other areas of the curr'lculun as well as in the 
basic skills. 



c P rov id e oppo rtuni ties \for ^tudentr tayfff^ UaAlC'TfrtHrMrr-other- 
currlcalar areas and to integrate other curricula r .learning into the 
acquisition of. basic skills^' 

' * * • , ' • 

d. Provide a variety, of opportunities* for students to pursue their 
educit iohal interests. ' , . 

e. Prioritise the special services provided students, focusing on their 
most urgent needs* 

f. Re s chedule the times when students are pulled out the regular 
- classroom so that they Kave the opportunity to participate in the 

full range of currlcular activities. 




sdith 



Coordinate the students' 'instructional program sea that: ' 

The InstroAon they receive while out of the classroom bull 
6rV extends; Ind/or relnfopces classroom instruction. 




have the .opportunity to acquire any necessary skills or 
they may have missed whli 



ly necessary sk 
lie out of the 



*ledge that they may have missed while out of the classroom. 

* 4 * ■ * * * 

* * h. Develop or refine methods of complication between % the ^classroom 
4 ^1 teacher jand specialist staff so that each is kept current with the 
' /WLj students' progress in both settings. r 

t *>ps|§nll locate time for classroom teachers and specialists^ 
r - students' instructional. activities together. 

^ ' J. kxplbre ways of motivating each student to bee one responsible! fbr 
f his or her own learning and work tojp eep are him or her to firict ion 
>v successfully in later grade* levels.* 



K^oj>lan 



the 



staff and others at the school. The SSC/SAC/BAC along with other staff 
and parents should' review these suggestions, determine their potential 
effectiveness for program improvement, and then decide how your ongoing 
planning, translating and 'evaluation procedures will be uSed to 
incorporate\them into your program. 



Selected Opportunities for Improving 
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j c. the Effect of support oh instruction 

The' information collected in the first section 
of this "handbook, /The Effect of Instruction on 
Students becomes the base for further 
investigation into this section, "The Effect of 
Support on Instruction What the reviewer has 
learned about how and what, students learn, the 
. learning environment, the effect of special services 
for the educationally . disadvantaged and Halted- 
English-pr9f icient students and students with 
exceptional needs are primary pieces in the process 
of gathering information necessary to judge the 
effectiveness of a school program. In looking at 
the support areas of staff development, parent 
participation and education,* health and guidance, 

and dist r i ct s u pport, reviewers begin to deve lop an 

understanding of how the instructional program, came 
to be the way It Is and why. 



The process of synthesizing information begins 
in a review as soon as bits of information begin to 
fit together into larger segments. 

i 

For Example': The reviewers observed students 
using manipulative materials during mathematics 
instruction in several of the classfoqgp visited* 
Interviews with staff and a* review of the staff 
development records Indicate that in-service traln- 
^ ing sessions on the use of math manlpulatlves had 
been held ami that staff felt they were worthwhile. 

Thus, tfie reviewers in the example cited wefe 
able not only to begin to understand why mathematics 
Instruction was the wajl if was, but also were able 
to observe the effects/of the staff development* 
sessions as students were using jpanipulatlves In 
several classrooms, flowever, the "whole** of staff 
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development had not emerged* Remaining questions 
Included: How were .decisions about staff develop- 
ment priorities made? Who had participated in the 
sessions? The partial effect of staff development*** 
observed and now served to direct further ^inquiry. • 
It Is important to note that only when v the remaining 
questions have been answered and the "whole** of 
staff development Is known can reviewers judge the 
effectiveness of staff development 

• ■> 

The review process works not only from the 
student througK Instruction and support to planning, 
but also In reverse order* 

For Example: The reviewers learned from the 
school plan that the staff would have in-service 
tr aining on how to establish mathematics learning 
centers. They further learned that all staff had 
participated la the in-service training sesslona 
that were designed, to help teachers establish and 
monitor learning centers where students could 
practice the mathematics skills being learned and to 
-apply "mastered" skills. However, no learning 
centers were observed In the classrooms r and the, 
teachers stated that the in-service training 
sessions were very Interesting but that they had not 
yet had time to Implement the suggestions* 

Thus, the effect on students of this segment of 
staff development was not observable* 

It is* critical to remember |£pt evaluation of 
support activities Is directed to the effect of 
support activities on instruction, not parent 
Involvement, for example, as an' isolated element, of 
the school program, nor the evaluation of district- 
level support as something apart from what Is 
happening In the Instruction of students* District 
support activities may appear to be of high quality, 
but" If they are not appropriate to the school 
program, they are not effectively supporting tha 
Instruction of students. 

. ,. * 13B 



THE EFFECT OF SUPPORT ON INSTRUCTION: 



STAFF DEVELOPMENT 

n 



This criterion focuses on how effective staff 
development activities have been in increasing the 
skills and knowledge needed by the teachers* aides, 
other* staff and yoljmteera to Implement the planned 
program. '-V** 

The effect of staff development on the instruc- 
tional program can be viewed from two perspectives: 

• One, analyse completed staff development activ- 
ities, and ffnd what effects or traces there 
are on the instructiona l prog ran. Determine 



_ " . 7: — w.— -- i — - Z-L r_ 

what kinds of staff development have been 
offered and for whomi Review the school plan, 
identifying staff development assessed needs 
jind planned activities. Talk- to the principal, 
the program coordinator, district personnel, 
and responsible SESR program specialist or 
whoever Is responsible for staff development to 
find out what- has been offered, why It was 
offered, who participated, hoq it was pre- 
sented, and by whom. Verify and add to this 
Information by observing staff at' work with the 
students and questioning them about their par- 
ticipation In staff development activities. 



• Two, trace*etaff development through Instruc- 
tion by establishing the types of instructional 
programs that are in existence and determine 
' ^ what staff development has been offered to sup- 
port the program. For example: as a reviewer 
you learn that a new writing program has been 
implemented. Determine what staff development 
was provided to support* the Implementation of 
the writing program. *\ 

Remember that the review of staff development 
is focused on the effect of the staff development 
activities. While knowledge of the kinds or number 
of activities engaged in by staff members and volun- 
teers is important for developing an understanding 
of what has happened in staff development and how It 
might be made' more effective, you will be judging 
the effect of the staff development act ivitie^t-from 
whatever source or whatever nature — oriVthe ^Instruc- 
tion of students and Instructional support and 
improvement process activities. 



NOTE: All adults who work with students should 
participate in staff development: teachers, aides, 
specialists, resource personnel, principals and 
other administrators, parents, and other volunteers. 
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CRITERIA FDR JUOGING QUALITY 
THE EFFECT CF STAFF CEVELOBCNT ON I«TRUCTION 



This criterion focuses on -ho* effective staff ttevelopnent activities 
have teen in increasing the skills and kweledge needed by the 
teachers, aides, other staff and volunteers to Implement an 
instructional program responsive to student and progrsn needs. 
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Staff envelopment activities have been 
lfcdted and have little or no relationship to 
the planned program they have had little or 
no effect in increasing the skills and 
frwwledy o f the adults. Therj is mlsinder- 
standing oT lack l>f ' gnirstandi ng ~5T~ Vne' 
intent of the schools planned program. Staff 
Miters era unclear Oout their individual 
respormitoilitiea and have had little' or no 
trtKStanding **** *et others are doing or 
hoe that ttey do fits with what others do. 



E/S 

Teachers 
Aids- 
Other steff» 



I I 



vbli/teers** 



in Mjplying this criterion consider the effect of staff development on 
the Instructional progran including services for students 
needs and *>ilitites (LEP, Title 7/SCE, special Ration, and gifted 
and talented). Include all staff development activities (youp and In- 
dividual) provided for all staff and volunteers involved in \he groQra* 
regardless of the source 6t finding utilired toprovidi sutf. activi- 
ties; i.e., district, SESR, co^ty, SIP, Title I/SCE, and so forth. 



Staff development activities are increasing 
the skills and knowledge necessary for imple- 
menting the program plannfed to meet student 
end program needs, the activities are addres- 
sirvg, on a priority basis, those skills and 
TJwI^'mWiteedea to implwent 
program. Staff * development activities are 
helpi^j to increase the skills and knowledge 
needed by each person to carry out his or her 
responsibilities; most members of the instruc- 
tional staff are applying the skills and know- 
ledges addressed in the staff development 
activities. Staff generally understand the 
intent of the school's planned program. Most 
staff mwbers understand - their individuel 
responsibilities for implementing the progrw 
art tow what they do fits with what others do. 



Staff development activities have been hig«y 
effective in en* ling the adults to imp lament 
en instructional progrmn responsive to student 
and progran needs. The adult knowledges and 
skills needed to Implement the planned prograa 
if la d a n d add re s sed In _*tm*f 
development activities. Each adult has learned 
whatever he or she needed to learn to carry 
out his or her part of the planned progree. 
Staff members understand the school's planned 
progran, their Individual responsibilities for 
Implement ing it and hoe tfwt they do fits 4th 
what others do. There Is obvious commitment 
to continued participation In staff develop- 
ment activities and to applying, the acquired 
knowledge and' skills. 



HIGH 
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Sff include the principal, other administrators, and support staff (certified and classified) eho are directly Involved In 

„ N|ing the program. 

"Vblunteers Include parents, comm/iity members, cross-eged tutors, and student teachers. 
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GUIDE FOR COLLECTING INFORMATION ABOUT STAFF DEVELOPMENT 



Primary source of Information: ■ 

Interview * 

What changes/ refinements have staff members 
made in working with students as a result of 
the staff development activities? 

m 

How are staff supported in implementing newly 
learned techniques, materials , and/or 
%t/ategiea? 

How are certified staff prepared to work within 
the cultural differences of students? Ape 
they well-prepared\ to meet the needs of LEP 
studeflEt, gifted students, students with 
except ional needs t or educat lonal ly disadvan- 
taged students? _ 

Are they prepared to guide the personal and 
social development of each student as well as 
to Instruct in currlculwm-ereas? 



How * do the parents, community members and 
Other volunteers work with students? Are. 
their skills adequate? Is this consistent 
throughout, the classrooms? 

How da instructional aides reinforce skills and 
assist students With learning activities? 

Whet kinds of in-service training have certi- 
fied staff end others been given to enable them 
to identify behaviors which may require 
referrals? 

Whet in-service activities and ongoing assis- 
tance are provided regular classroom teachers 
to meet the needs of students receiving special 
services? 



Verifying sources of information: ^ 
observation/documents • 

Observation: 



What effects of staff development 
efforts are visible In the class* 
room; do adults seem to have a 
sense of direction end progress in 
staff development; do adults seem 
to have developed cooperative 
relationships designed to carry out 
the school's planned program? 



Documents ; Review*" records of 
Itaff, staff development, activi- 
ties, council meetings; needs 
^assessment information; communica- 
tions to parents; evaluations of 
staff development by staff; evalu- 
ations of stsff development imple- 
mentation in the classroom; SESR 
comprehensive plan and/or PL 94-142 
opportunities for staff develop- 
ment. Whet kind of match exists 
between the needs of the students 
and staff as expressed in the 
school plan and the staff develop-^ 
ment activities? Compare the needs 
expressed in the plan with what is 
being offered. 
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Area of Investigation 

Relationship to planned 
program 
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Primary source of informatipn: 
interview 

• 4 

Hcjw were aides, council members, parents, 
ctMiunity members, and* other volunteers 
involved in designing their staff development? 

What roles does the principal play in -staff 
development? The district? 

What is the overall plan for staff development 
activities? (Consider frequency, tine lines, 
sequencing*) How does it relate to tjv needs 
of qtaff to carry our the planned program? 

What opportunities a re there for staff to 
discuss together what They are trying to do and 
the effect of what they are trying to do? 



What kinds of opportunities are there for joint 
teacher-aide in-service training? Foj joint 
special education and regular education staff 
development activities? 

What are the procedures for articulation and 
Integration of skills and knowledge acquired in 
staff development? fc * 



Do staff members ' and volunteers think^h 
staff development activities have been u fl| 



at 

1? 



How are council/committee members prepared to 
fulfill their responsibilities? How effective 
* do they think their preparation has been? 

f - 

z Do the support staff members (librarian, nurse, 
speech **nd language specialists, and psychQlo- 
gist/counselor , pregram specialist , etc . ) 
understand their toles in implementing the 
planned programs as described in school plan? 
Hqy helpful have staff devejjipment activities 
been to them? 



Verifying sources of Information; 
observation/documents 



• 
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Area of Investigation 

0 

Supporting end 
evaluating staff 
development activities 



Primary .source of Information : 
interview 

How has the school used its resources for staff 
development? Are * teachers and otfier staff 
members encouraged to lead staff development 
sessions? 1 



Verifying sources of Information : 
observation/documents 



Wha't external . resources has the school used 
(e .g. , teacher centers t professional develop- 
ment centers, county t district, and SESR 
resources, and the special education service 
region)? 

How has' the school' utilized its community/ 
parent resources? Ho* effectively do staff feel 
these resources have been used? 



How do staff members and administrative 
personnel evaluate the effect of ,the staff 
development activities? 



r 



How are staff development evaluation results 
used? 




'CPPORTWniSS FOR IMPROVING STA^R DEVELOP T 



The statements lidtfid below indicate actions ^khmay have been or 
need to be taken to improve the effectiveness of your prpgranu The 
specific opportunities selected by the reviewers reflect their 
understanding o\y our program and their best suggestions for *hht your 
next steps might \>e to make your program more effective for students, 



t 



a. Identify^tne skills and knowledge needed to carry out the planned 
" pfogran, including services for stutfents with speGial needs. 

b. Assess existing skills and knowledge of staff, parents, ccmmtnity 

* merters fcnd ot!3er volunteers working in the program through ongoing 
evaluation, * * 

• c. Deteimine thef differences between existing and necessary skills and 
, knowledge. f N <- 

~d^5et priorities for group and individual staff development 'activity 

e. Base activities on the differe nces between existing and necessary 
skills and Jlbwledge of parents, ccrrmtnity members, and ethers. 

» ^ " 

f. Involve the staff, parents, cotim/iity members, and -ethers in deter- 
1 i*iningL what their staff development activities should include and 

* * how they would be presented and* by whom. ^ 

g. Individualize activities to me* -the varying needs t>f the staff. 

h. Allocate sufficient time fqif st3ff devetopment activities. > 

i. Utilize staff skills and talents for providing staff development 
• activities % ' v 

1. Use school, district, Pntoram Improvement for Imprbving School. 
Consortia, „ SELPA, cemmpity, and ^cfcher^ resources, for .staff 
development activities. 

# 

k. Incorporate into' staff (fevelopment activities ways of confirming 
that* the adults have acquired and are using skills and knowledge 
presented. x 
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staff, and others at the, school.. The .SSC/SAC/BAC, along with .other 
staff and parents, should review these suggestions, deteimine their 
potential effectiveness for program improvement,' and then decide how 
your ongoing planning, translating, and evaluation procedures will be 
used to incorporate them into your program/ 

Selected Opportunities feft Improving ( • 
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THE EFFECT OF SUPPORT ON 



This criterion focuses on the extent to which 
parents are involved in and knowledgeable about 
their children's program at the school and reinforce 
their learning at hose. 

• • 

Parent Involvement and education is a broad 
category that includes parent involvement In the 
classrooms and the tottl school, prog ran; keeping 
parents informed about their children's progra and 
the school program, including the array of services 
for students with special needs; preparing parents 
to assist in the school program; providing oppor- 
tunities for parents to explore their interests in 
areas related to child growth and development and 
parental guidance. In reviewing how parent particle 
pation and education affect" the instructional pro*- 

gram, find out how well Informed the parents are 

\ 

% 



NSTRUCTION: PARENT PARTICIPATION 

J 

\ 

about the program and the day-to-day actlvltJ.es of 
the students, how parents are directly Involved in 
their children's educational experiences, how they 
are Involved in the school program/ and in what 
kinds of parent education activities they have been 
involved* ^ * 

i • 

"Also, talk to the teachers and the admlnistra- 
tlve staff about the ways in which they communicate 
with parents about the school^ progr am' and their 
childrens' work at school* Review written communi- 
cations such as school and/or claaa newsletters?* 



* 
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CM4thIA FOR JUDGING QUALITY 
THE EFFECT OF PARE* ^/WTICIPATICN Atf) EDUCATION ON I>6TRUCTION 

This criterion focuses on the extent to which parents are involved in In applying this criterion ludge the quality of the ^^^^ of 
end ^it^lT^Jt their diildren»s progran at the school and the effect of parent participation and education on instruction 
reinforce their learning at home. 



Parents have little understanding of and 
ccpnltment to the school program, the school 
plan or program improvement efforts. Few 
parents are involved In the classroom and 
school program or in parent education act lvl-* 
ties; their Involvement Is infrequent and 
sporadic and provides little support to the 
Instructional program or to efforts x to 
implement the planned .program. Parents are 
unaware of the Chilean's day to day activi- 
ties (including thos* specified in IEPs ot 
ILPs). Parent education has had little if any 
impact on parents readiness to become Involved 
in their ch tl <fr en 1 s school program, to support 
their cMlcjyfen in the school activities, or to 
assist them at heme. 



E 
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Most of the parents actively involved with the 
school program understand and support" the 
program for their children; they are aware of 
the school plan and specific efforts to 
improve the program. In many of the class- 
toots involvement of parents has enriched and 
extended the instructional program in ether 
classrocms, parent involvement is "in frequent 
or has made little difference in how the 
teacher organized and manages the classroom. 
Involvenent of parents in .school activities* 
outside the classroom has provided support for 
implement at ing the planned school improvement 
efforts. While parents not actively involved 
have seme understanding of their children's 
program and are aware of- their children's 
day-tQ-day act Wit ies (including those 
specified in IEPs and ILPs) they have limited 
knowledge of the specific Efforts to improve 
the school program; they are generally not 
aware of what they could do personally to 
support implementation of the program for 
their children. Parent education activities 
have, made*lt ptassible for many rJerents to 
participate in the school program, to support 
their chiltfren in ?Keir school activities, and 
to assist* them at home. 



Parents are enthusiastic and committed to the 
school program and improvement efforts. They 
are knowledgeable about the school plan 4 and 
know when and how they can assist in imple- 
ment ing the plannetf program. Involvement of 
parens in the classrooms extends and enriches 
the instructional program and expands the 
teachers 1 capabilities to provide Instruction 
«J supervision of the students. Parent 
involve- ment outside the classroom is a 
continuing source of active support in 
i/rplerwntlng the planned progfam. Parents* 
knowledge of the „ instructional program, 
including individualized learning plans (IEPs, 
ILPs), wvJ how their children are learning 
allow them to support their children' In their 
activities at school and to reinforce at home 
specific skills and concepts tautfit at 
school. 
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GUIDE FOR COLLECTING INFORMATION ABOUT PARENT PARTICIPATION 



Area of Investigation 

Communication to par- 
ents 



Primary source of information: 
interviews 

Haw does t\ie school communicate with the 
parents? By newsletters? Parent conferences? 
Open house? 

*Do the various means of communication from the 
school to the home provide parents with a com-^ 
plete picture of the school program including 
all services available to students with special 
needs? ^ 

What provisions are made to comnunlcate with 
parents of LEP students in their primary 
language? 

• 

Is there an active liaison with SESR Community 
Advisory. Committee (CAC)? 

How does "the district communicate • with* parents? • 

Do teachers periodically send student's com- 
pleted work home? v 

How well-informed are parents .about the day-to- 
day activities of their children? 



Verifying sources of Information: 
: observation/documents 



Observation ; Look for evidence of 
parent Involvement in the class- 
rooms y llbrary f media or resource 
center, office, and other areas of 
the school program* How effective 
does this participation seem to be? 
What are parents doing in the 
classroom, the office, * the* 
teacher* 8 room?' How effective does 
this participation seem to be? 



lorn se 
? for 



Documents : - LoolT for records 
ing the various ways in 'which 
school communicates with 



shov- 

the 
parents: 

back to school night, open house, 
bulletins, newsletters, neighbor- 
hood coffees,- telephone trees, 
parents* conferences, use of com- 
munity resources , parent education 
offerings, lEPs and ILPs. 



Parent/community 
Involvement 



/ 
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How are parents and community members 
encouraged to participate in the school and/or 
classroom program? 

Are parents and, community members Involved in 
the program for example, as tutors or 
Instruct lonal assistants , resource people , 
library aides in the resource center, on the 
playground, or in other capacities? 
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Area of Investigation 



Primary source of Information: 
interview 



Are parent and, com unity - members Involved In 
activities such -at, assessing student health 
needs , rec rid t Iqg other patents for councils , 
serving on PTA, or other com! t tees, working 
with students after school, speq^^p Interest 
activities, assisting with the home-language 
surveys? 

How are parents of students with exceptional 
needs involved In planning and reviewing IEPs? 
How are parents of LEP students Involved In 
developing the I LPs? 

How have volunteers been prepared to do what 
they are doing? 



Verifying sources of Information; 
observatldn/documente 



* 

4 



t ' 



Parent education 
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kfm parenta and community members Involved In 
providing enrichment activities, in a planned 
Instructional activity, In writing a newsletter 
for parents, in providing parent education 
sessions for other parents, and In translating 
for USP parents? 

Have parent education Interests and need* been 
expressed? 

What kinds of parent education activities 
have been offered the parents? How many 
partlclpa£p? 

How effective do parents believe these activi- 
ties have been? 

In what ways is the district supporting parent 
education? 



' 6 
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CPPCRTUNITIES^HR MTOVING PARENT 
PARTICIPATION AND EDUCATION 



The statements listed below lndlpate actions which may have been or 
need to be taken to Improve, the effectiveness of, your program. The 
specific opportunities selected by the reviewers reflect their 
understating pf your program and their best suggestions for what your 
next steps mlojrt be to make your program more 'effect ive for students, 



staff and others at the school. The SSC/SAC/BAC along with other staff 
and parents should review these suggestions, determine their potential 
effectiveness for program improvement, and then decide how your ongoing 
planning, translating, and evaluation procedures will be used to 
Incorporate^ them into your program. 



a. Use a variety of ways to encourage parents and ccnrouiity members to 
participate in the classroom and school program. 



Selected Opportunities for Improving 



b. Work to sustain involvement of gjrents and community (neuters and 



parents 
4Rerns. 



provide for their interests and c 

c. Identify and use the talents, interests, and knowledge of parents 
and community members in the classrooms and school program. 

d. Provide opportunities for parents who work otirlng the school day to 
support and contribute to the school program. 

e. Involve parents of students with exceptional needs and LEP stuofents 
In planning and reviewing ILPs and IEPs. 

f. Provide two-way home-school communications regarding the student's 
day-to-day activities and the sctuul piixjiaii. 

9. Provide home-school ccnmnication and ^parent education and 
involvement oppbrtunlties in the primary language(s) of the limited- 
and non-£nglish-s'pe$king parents. 

* 

h. Provide opportunities for parents <*to express interests- their 
interests and needs and involve them in planning parent education 
activities. 

» 

i. Encourage parent participation in support groups for parents of stu- 
s dents receiving special services (e.g. |t BAC, SAC Community Advisory 
Cornell). * 

J. Explore the concept of a school baseo/dormutity education progran. 



THE EFFECT OF SUPPORT ON INSTRUCTION: HEALTH AND GUIDANCE SERVICES 



This criterion focuses -on how effectively the 
health and guidance services provided the student 
are in Meting the student* s needs. 

In reviewing the effect of health and 
guidance activities, determine how students* 
emotional, mental, and physical health needs are 
assessed; how the assessment Information is used; 
and what kinds of follow-up, procedures are being 
ufeed. 

Observe individual students in the class- 
rooms to determine how the classroom curriculum, 



organization, and environment have been accommodated 
to the ^health and, guidance needs of the students. 
Use this information to frame interview questions 
about health and guidance services. 

* Question the School nurse; the language., 
speech, ' and hearing specialists; .the resource; 
specialist; the counselor; and the psychologist to 
develop a complete * picture of the health and 
guidance needs- at the school ,and how the specialists 
work to meet those needs. Question the' classroom 
teachers and the principal and/or other 
administrators to learn more about the effect of 
these support services. 
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* CRITERIA PV JUDGING QUALITY- 

• THE EFFECT OF HEALTH AM) 'GUIDANCE SERVICES 

K?« sis 



Assessment of student's emotional-mental and* 
physical health needs Is limited to statutory 
requirronts jnd. therp Is little or no 
foHowrup- ResajrAs available ^to -the school^ 
have not been explored and/or are net being^ 
effectively 'used. Specialist ^support staff 
provide little ongoing assistance to students; 
classroom teachers receive little he§Jth 
information about th*lr students, nrfr do they 
receive • direct assistance or in-service 
training to help them work with 'the students 
with health ne*Js in their ciassrocm. 
Generally parents , receive notice of their 
children's serious health needs, but follow-up 
is sporadic rather than routine. There is* 
little or no formal Instruction In health 
educat ion. 
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The" students' jp*rtfi5*%l- mental and physical 
health needs have been identified althouqh r in 
swneareas, screening, referral, and qssess- 
•mefifprocedures are not tintty and/or they are 1 ' 
limited/ Follow-up activities, including 
•services for students with speciai needs, are 
being 'carried out to remediate serious 
Wherever possible) end/or - to ineffease 
skill>!sSr stud^fts to ^c'ope with health 
► prdM»ns?|tany *)f the resources of the school 
and coirnuni^are being used for follow-up; 
sane available resources are not being 
t^>ped and/ or used as fully as possible. The 
specialist' support staff and instructional 
staff Share important hrfltK information; the 
information is frequently used as aj>a$is for 
altering the curriculum, organization, and 
environment for the students in 'order to 
arconnodBte their specific needs. Parents are^ 
informed 9/ their children's emotionai-*nental 
and physic^ health needs, and the school, as 
requested, provides informat ion regarding 
resources available for follow-up services . 
The school progr am includes instruct ion in 
several of the major content areas of health 
education. 



The identification of stOdsnt's emotional- . 
msntal and physical . health needs is based on- »■ 
^propriate and timely screening of auditory, ^ 
visual, dental, physical* and speech needs, 
individual referrals, and on established 
. criteria and procedures for identifying 
students with guidance needs. Follow-up 
activities, including services for students 
■ with sj»ciaT needs', Have been successful in 
rowdiating needs (wherever possible) and in ^ 
iocre»ing skills of students to cope with 
health problems. Available school and 
cownunity resources have been identified and 
\are being effectively used for' follow-up and 
for enhancing the health of students. The 
curriculum, organization, and environment of 
the classrooms accomodate the sm6W4^ health 
- needs of the students. Speci 9Bt support 
. staff provide ongding assistanceWo students • 
* "with identified needs, ' to classroom teachers 
* as they work with these students, and to thMr 
*" parents. The school program. includes appro- « 
' priate grade-level instruction .in the major 

content $reas of health educatioVij * 1'64 
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ft 



HIGH 



Art* of ^ Investlgatl6n 

Referral/assessment of 
needs ' 



Follow-up procedures 




GUIDE FOR COLLECTING INFORMATION ABOUT HEALTH AND 

r t 

Primary source of Information: 
j| ptervlew8 . 

How are emotional, mental, and physical health 
need 8 s of the student Identified? * 
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Is there an established referral process? Is 
it ^tell understood by all personnel? 

Who does the assessment?. Nurse? Psychologist? 
Classroom teacher? Resource specialist? 

/ Speech, language, and hearing specialist? Is 
a x multldlsclpllnary approach utilized in 
assessing needs? ? 

How timely are the assessment procedures? 

Are assessment 7 services equally available to 
all students? * « 

HoV *re assessment Results utilized by per- 
sonnel working directly with the student? 

How are parents Informed ol their child's 
health xieeds? Is communication provided in the 
* language* tof the parents? 

« 

Are parents Informed of services available in 
the community, district, county, and state? 

What 'foll6%mip procedures are used at the 
school? * Do the appropriate specialists work 
with ^identified students on an ongoing basis? 

Do> the^ specialists confer abput individual 
students? Are the classroom teacher, the 
principal, and the parents Included In these 
conferences? 

. Itow are the health and guidance resources of 
the School community, district , county, and 
state' used v to help meet student needs? 

*j ** 
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GUIDANCE 

Verifying sources of Information: 
observation/documents 



Observation: 



Is there 



a multi- 
sets on a. 



disciplinary team which 
regular basis to address student 
referrSls/assessment? Does it 
appear diat the health and guidance 
needs of the students are being 
met? Does the school seem to miss 
some students? Is there evidence- in 
the classroort of ^ad aptation of 
learning environments^ to student 
needs? Is health education a 
regular part of the curriculum? 

Documenty . Look at student^bealth 
and guidance records, IEPs, the 
communication systems used .among 
parents/specialist/ teacher lesson* 
plan (health education), the school 
plan* < . 
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Area of Inveftigation 

Use of assessment 
information 

% 



« Prtpary source of information; 

interviews 

t _ 

How do the specialists inform the teacher about 
the student's needs? Abbut changes in needs?\^ 

How do the specialists work with' the teacher to 
endure that the curriculum and/or learning 
environment support the health and guidance 
needs of the students? f 

Are* other personnel who work directly with the 
student aware of the modified environment 
and/or curriculum? 



Verifying sources of information: 
observation/documents 



Health education 



What kinds of health education are included in 
the curriculum? * . 

What relationship exists between the kinds of 
health education proyided ,\and the needs of 
students' as Identified in jjhe plan, and the 
assessment of students? 
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The statements listed below Indicate actions which may have been or 
need to be taken to improve the effectiveness of your 4 " program. The 
. specific opportunities selected by the reviewers reflect their under- 
standing of your program and their best suggestions for what your next 
next steps mUJtt be to make your program more effective for students, 



staff and others at the school. The SSC/SAC/BAC along with other staff 
and parents should review these suggestions, determine their potential 
effectiveness* for program improvement, and then decide how your ongoing 
planninq, translating, and evaluation procedures will be used to 
incorporate them into your program. 



a. Est*fcllsh and use procedures for screening, referral, and follow-yp 
of student health needs (auditory, visual ctental, physical, speech 
and language and ether health needs). 

b. Provide hea^h education instruction. 

c. Establish and use procedures to identify t refer, and assess needs 
of students for guidance services. 

d. Provide direct service to students and assistance to teachers in 
modifying the learning environment of their classrooms to meet 
individual student needs. « 

e. Use health and guidance assessment Information to madlfy cixricukrri, 
classroan, organization, and/or learning environment to meet indivi- 
dual student needs. 

f. Establish and use follow-up procedires to cormnicate the results 
of health and guidance screening to parents and teachers. s 

g. Identify and use available state, federal, district, and community 
resources. 

h. Coordinate health and guidance services so that students receive 
mexiirun benefit fran services delivered. 



Selected Opportunities for Improving 




1. Provide health and guidance assessment services and information In 
" the primary language(s) of the students and their parents. 

•J. Consider cultural differences between hone and school In providing 
health and guidance services. 
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THE EFFECT OP SUPPORT ON 



This criterion focuses on how effectively the 
district is supporting the school in its efforts to 
improve the planned program for students. 

In reviewing district support of the school's 
improvement efforts, examine two areas: how the 
district supports instruction directly (e.g., 
allocation of resource specialists, development of 
proficiency standards, development of referral 
procedures, curriculum development activities) and 
how the district supports instruction indirectly 
(e.g., assistance with staff development, training 
for school site Council or school adivsory council 
members, community advisory committee, and other 
activities). Remember, district support includes 
only those efforts of personnel from the 'district 
office; it does not include the efforts of those 
personnel .who work at the school every day. 

Look .for policies* and procedures that the 
district has established to provide leadership to 
its schools as well as action the district has taken 
in carrying but such policies and procedures. Relate 
what has been learned" about district support to what 
has been stated in the school plan. While many of 
the policies and procedures which the district uses 
to guide schools in school improvement efforts are 
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INSTRUCTION: 



DISTRICT SUPPORT 



contained "in Part I of the District Master Plan for 
School Improvement, these are not the only policies 
or the onxy' means by which the district provides 
leadership and direction tb its schools. Be alert 
to other meaps of communication — other policies and 
procedures set by the school board, administrative 
procedures , and the historical "ever vcjpe jL ^jmows 
that • • traditions. Determine what impact such 
leadership efforts have- hadj| Nete the policies and 
procedures governing special education services in 
the local district. • 

Much of the fact-finding regarding the eff.ectf' 
of district support /will be covered during assess- 
ment of the preceding support items. Direct 
evidence will be gathered through interviews with 
district and school personnel. 

Question the staff, the principal, and district 
staff to find out what the district does to support 
the school program and how helpful that support has . 
beett in carrying out the program. To find out how 
effective such actions were, use information 
, gathered during classroom observations and frqpi con- 
versations with school and district staff. 

* I 
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CRITERIA FOR JUDGING QUALITY 
T>€ EFFECT OF- DISTRICT SUPPORT 



This criterion focuses on how effectively the district is supportinp 

J program for the 



the school 
students. 



in its effbrts to improve t*e 4 planned 



Apply this criterion to Judge the quality of the program in terms of 
the effect of district support for the school prooram. Consider those 
district services provided through regular district f^s as well as 
those provided by special funding. 



District policies and procedures to gjide 
and support the schools either have net been 
defined by the district or are rnknown to this 
school. The district strategies to assist 
the school *re vague or stated in very £neral 
terms and encompass few of the resoi«es 
availrt>le to the district. TheYstrategies 
were not planned Jointly by the / school and 
district and, therefore, show little 
relationship to the specific objectives, 
needs, and priorities of the school. Efforts 
to guide and support the school have had 
little impact on the school's efforts to 
Improve its program. 



District leadership and support to the school, 
as defined through policies, procedures, and 
assistance strategies, are known to coencil/ 
caimittee* members and to $one other staff and 
parents at the school. T^e district's assis- 
tance to the school coordinates and uses many 
of the district, corrmrity, Vd SE5R resources, 
available to the district and assistance in 
curricula improvement and staff development 
is generally consistent with the school's 
objectives, needs, and priorities. The dis- 
trict's implementation of these policies, 
assistwe strategies, has helped the school 
make progress toward improving its projjram for 
students. 



District leadership and support to the school, 
as defined throu^ policies, procedures, and 
assistvre strategies, is well known to the 
cocncil/cormittee staff and parents at the 
school. Jointly planned by the cotncil/ 
committee, school staff, and district staff, ^ 
district assistance, including assistance in* 
ct*riculun improvement and staff development, 
is based; on the schools' needs, objectives, 
and priorities and effectively coordinates and 
uses available district, comi/iity, SESR, 
state, and federal reso^ces. The district's 
timely «J effective implementation of its- 
policies, procedures, and assistance has 
contributed significantly tp the school's 
c*>ability to respond to students' needs and 
interests and has resulted in a hitfi degree of 
* commitment to and enpectations for success in 
roving the program for the students. 




Area of Investigation 

Communication among 

district and school 



District support 
strategies and 
activities 



Use of resources 



7-^82990 
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GUIDE FOR COLLECTING ,INFO 



ION ABOUT DISTRICT SUPPORT 



How 

.between 



Primary source of information: 
interviews 

v^ll-known are the communication channels 
een^the district and the school? 



How well understood by the staff is the direc- 
tion established by the district for school 
* improvement , bilingual education , compensatory 
education, and so forth? 

Ho* well understood by the staff is the direc- 
tion established by the SESR foe special 
education and related instructional services? 

What kinds of support do the staff and 
principal receive in carrying out established 
' district directions and policies? 

Are efforts to improve the program for Title 1/ 
SCE, LEP, special education, and gifted stu- 
dents seen as separate from the regular school 
program? ~ 

What kirtd of input does the school have in the 
design of district strategies and activities? 

What di8tric£ activities or support strategies 
are being implemented? What future activities 
or support strategies are being planned by the 
district? 

In what ways does the district support the 
school in planning, implementing, . and evalu- 
ating the school program? 

How appropriate are support strategies to the 
needs, priorities, and objectives of the school 
program? ^fc 

What kinds of resources are beit^g used to 
support the improvement process at the school? 

How are these resources coordinated? 

11-72 



Verifying sources of information; 
^ observation/documents 



Observation : Look Jfer evidence of 
district support i^^he classroom. 
Does the school receive district 
help in curriculum development? 
Health and guidance? Evaluation? 
Planning?. ILP, IEP development and 
implementation? Staff development? 

Documents : District master plan, 
proficiency standards, and 

policies and procedures; staff 
development records, council 
minutes, *the school plan. 



\ 
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CPPORTlNITIES-rOR^ IMPROVING (DISTRICT SLPPCRT 



The statements listed below indicate actions which may have been or 
need to be taken to improve the effectiveness of your program, ire 
specific opportunities selected by the reviewers reflect their 
understanding of your program and their best; suggestions for what your 
next steps might be to make_your program more effective for students, 

a. Determine -what policies* procedures* and strategies are needed to 
guide and support program improvement efforts. Modify existing 
exgectations/directWesVstrategies accordingly. 

b. Identify current ctwneH of coiwnunidation^iich convey information 
accurately an/ reliably among administrator, governir^boardj, 

and the school. 

c. Arrange for staff development to ensure full undemanding of 
important issues and concepts communicated from the district level 
to the schort,. especially those related to applicable la"ws and 

' ^regulations, consolidated applicagtaj programs at the school, and 
*' policfiV and procedures , contained lo ttie district master &aru 

d. Arrange for curriculum and/or istaff development assistance's % 
nested for implementing the plfnned program. . * . 

e^^ssess th$ -effectiveness of^furrent district services to the school 
-^nd Identify resources never befoife utilized. 

f. Request districtlsESR support* services appropriate to the school; ' 
program. ; 



g^Wbrk with the district office as you determine. your objectives, 
needs, and priorities fey' the coming jear, and Jointly plan what 
nd4ta * 
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len resources are' needed to^meet these objectives and neSs. 



staff, -and others at the school. The SSC/SAC/BAC, along with other 
statf a^xJ parents i should review the^e suggestions, . determine their, 
potential effectiveness for program improvement, and then decide how 
your ongoing planning, translating, anpl evaluation procedures will be 
used -to incorporate them into* your program. 



Selected Opportunities for Improving 



•c 
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* D. THE EFFECT OF THB ^CPROVEMgyr PROCESS 

y • ' I 

This section includes two .areas of review: the 
effect of tfie School Site Council/School Advisory 
Council/Bilingual Xdvisory Committee (SSC/SAC/BAC) and 
the effect of planning/, translating the plan into 
action, and evaluation. These two areas include the 
methods or procedures used, to improve or maintain the 
quality of education provided fjjjr students. Together, 
they constitute the improvement process. In reviewing 
the work of the, SSC/SAC/BAC and in finding out about 
planning, translating, and evaluating activities, the 
. reviewer learns why instruction and instructional 
m support are the way they are -a/id what, might be changed 
fin the Improvement process to increase and/or maintain 
the effectiveness of* instructional and- support 
activities. '«* 

The Information collected' investigating "The Effect 
of Instruction on Students" and "The Effect of Support 
*n ^natrjictiqn" becqpes thejbase for investigation into 
this section, "The Effect of thfe Imprpvement Process/." 
Y the 'effects of the improvement process should be 
i observable in the planned program, in the classrooms,. 
In the ways in which people work together, and in the 
program modifications identified by the school 
p -community. 

Reviewing the quality of pimping and evaluation 
actually begins with a review of the school plan. 
However, the process of planning $and evaluation is not 
v static — it vtf^volving^ changing> and 'dynamic. The 
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reviewer can see the effects of the planning ' and 
evaluation procedures that extend well beyond . the 
written plan. The reviewer .can develop an , under- 
standing of previous 'use of the procedures through 
interviews and can assess the effects, of the ongoing 
procedures t hrough obse rvqt ion , inte rviews , and 
documentation* 



Between planning the program and ~doing what has 
been planned are tTie crucial activities which translate' 
eas into action. These activities include communi- 
tion, collaboration, and mutual support among staff 
and others* at the school; definition of roles and 
responsibilities; appropriate personnel assignments; 
reallocation of time; scheduling; .coordination and 
sequencing of activities; space allotmen^, ordering bf 
needed supplies; and program monitoring. 

' 1 • ' - * * V ' 

_ _ T*!?!2!!&hout 5^ is section, it is important for the 
reviewer to recognize the type of planting and "trans-* 
lating apd evaluation procedures' *th$t have evolved at 
the school. The procedures may be very formal quite 
informal, or have elements of both. They may involve 
all personnel to the same degree, some personnel in a 
concentrated 'way, or ortly a few people. .Whatever the 
types of procedures , the reviewer's task is to fin* out 
how well they have worked to produce a program that 
meets the needs of the students, staff, and parents* 
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THE EFFECT OF THE IMPROVEMENT PROCESS: SCHOOL SITE COUNCIL/ SCHOOL ADVISORY COUNCIL/ BILINGUAL ADVISORY CCM4ITTE& 

9 • * \ 

This criterion focuses on how effective the 
SSC/SAC/BAC, hbve been in carrying out their responsi- 
bilities within the improvement -process at the school. 



In judging the effectiveness of the council/ 
committee in planning, monitoring, and modifying the 
school program, the reviewer will use information 



derived through observing the effects of the planning 
process on support activities and on instruction; from 
interviews with staff, parents, and council/committee 
members; and from documents, such as membership rasters, \ 
minutes , and agenda/* Evidence collected will include 
not/ onljk the work of the council/committee, bxtt also # 
what others in the schoo^commiinity know and how they . 
."feel about the work of th&council/comnittee. 



CRITERIA FOR JUOGING QUALITY 
t»€. EFFECT '(T THE SCHOOL SITE COUNCIL/SCHOOL AO VI SCRY COUNCIL/BILIGUAL AOVISORY CCfWITJTEE * 



. « vi • ^ ^ l_ off _H^ +h» w/wyaAC have been in Aoply thi* criterion to Judge the quality of the SSC/SAC/BAC in terms 

-MS the oTt 4 infect on the Indent process at the school as well as the 
Sn^llrogrU. * school program. 



\ 



Meetings of the SSC/SAC/BAC have been infre- 
qyent cfnd/or poorly attended; consideration of 
school 'corojnUv groups points of view when 
» assessing nearer establishing priorities, and 
ottfktminirtg directions for the program has 
\ befi /limited. T*T work of* the S9C/5AC/BAC 
f ^en*tally>is hot Jinown; the members do not see. 
their work as important to the school prAgr*?; 
little Is 'beinft done to courage, other 
parents ind staff \ to participate in the work 
^o^the'Ccwtficil/caiwttw. In developing, the 
school, plan, only a few key staf^members on 
^\<t*ie 'cqjn^fl/goiwittee were involved. Commu- 
^nipetWfapnAfcne tarious cotricils/ccranittees 
'[ft lifted; each plans separately. Council 
/tfSkrfcs deWtBtrata^lU^la knowledge* of, or 
• ^ccjiwitmeot tV the ^anrtW progYam and are 
.ga*extaly. *dt Jfcere o* the step* being taken 
to'tfranslefee the ckanned jtfdaranvlnto action, 
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In retjula* meetings, usually well attended by 
SSC/SAC/BAC membfers, points of view fron 
several groups in the school community are 
considered "when assessing needs, establishing 
priorities, and determining directions for the 
program. The wo/k of "the SSC/SAC/BAC is 
generally known; Ahe members and some other 

jistaff and parents see the council/corroit tee's 
work as important. Othef, staff and parents 
are encbura^pd to participate in the work of 
the council/committee; e.g., planning and 
monitoring the program. The council/ccrrmjttee 
serve's as a forum for discussing the develop- 

. ment of the school plan, including the budget, 
and has been somewhat active in reviewing 
implementation of the program and determining 
needed- modi ficat^ons. Each council/committee 

% is generally informed about the major deliber- 
at ions or recommendat ions of the others . 
Council'^ members and seme other staff and, 

* parents' -are* informed about and demdhstrate 
canfljtment to the planned program. Awareness 
of "st^ps being taken to translate the planned 
program. Jnto action varies from hi^i to very 
limited. • 



In regular, well-attended meetings of SSC/SAC/ 
&C points of view fircm all ^oups in the > 
school community have been actively considered 
when assessing needs,- establishing priorities, 
and determining direct-ions for the program. 
The council/ccrnnittee has been successful in 
involving other staff, parents, and comuiity 
member* in its work. The leadership of the 
council/committee during the development .of 
the school plan, including the budget ■ and 
during continuing review and modification of 
the program has resulted in increased cownit- 
ment to the successful implementation of the m 
planned program by other staff and parents at 
the school. Communication and cooperation 
among tfne different councils/await te«* has 
contributed to a well-integrated program* fbr 
students. Council members and others demon- 
strate a high leyel bf knowlege 'of and 
camtitment to the planned program, and they^ 
are well aware of the steps being taken to 
translate it into action. 
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GUIDE FOR COLLECTING INFORMATION ABOUT THE SCHOOL COUNCILS/COMmItTEE 



Areas of • Investigation % 



^ r 4W*y source of information: 
interviews 



Selection of members 



How were the pembers selected? 
vacancies filled? 



How are 



Preparation of members 



How representative of the parents in the 
community are the parent members? Did tl*e 
selection process provide an opportunity for all 
interested parents and staff to become members! 
How representative of the staff are the staff 
members? 

What in-service training did members receive 
*■ about the purpose of the council/committees .and* 

*^hat their r espons i bill ties are? 

How well do the members understand the purpose 
and the requirements of special funding 
sources received by the school? * 

... — • _ What other in-service training did they receive?, 

Who presented it, and how was it presented? 

How were decisions made regarding the kinds of 
f , * in-service training presented? 

Functioning of the counci^ How often are meetings held?, How well-attended 



littee 




are they? How representative of the school 
population, are those who . regularly attend the 
meetings? 

* \ What kinds of support services are provided *to 
the council (e.g., .translation services for Lep 
parents, scheduling and norticeT of meeting times, 
provision " of baby-sitting service, and 
communications abou£ the meetings)? 



Verifying sources of information ; 
observation/documents 

Observation and exploration with 
school %taff and parents : Does the 
council or committee seem to be 
representative of^its *pnstituerrt 
community? Does the sic Include 
parent 8 of students receiving 
special services, Ggifted and 
talented, . LEP, T^tle i/SCE 
students, and students with 

exceptional needsj ? 

i • ----- 

Document : Select *6t^ procedures, 
council/committee, agendaslteinutes/ 
by-laws attendance sheets, communi- 
cations, between school and home, 
school Community descriptions f anc j 
announcements of elections/ 
selections ^ 



/ 



< 
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Areas of Investigation 



* pri mary source of Information : 
interviews 



A 



How are meetings conducted?Who sets the agendas? 
Do "the agendas reflect the concerns and inter- 
ests of the school community? Do t\}e by-laws 
* and operational procedures facilitate the cpn- 
^duct of the business of the council/committee? 

How do the councils/commmittee keep members of 
the school * community (parents and staff) 
informed about the school program? 

few do parents and staff members inform the 
councils/committee of their concerns or. desires 
. for the school program? 

How are the members kept informed about what is 
happening in the ^chool program, and how well it 
id working 

How w*re the members involved in developing the 
plan, in determining desired student outcomes, 
in assessing needs and setting ^objectives, in 
developing basic apjfroaches or strategies, and 
* in designing evaluation , procedures? 



How are members' involved in pngoing planning, in 
monitoring -the program, and in making decision^ 
about what should be, modified "and how? How <ty 
the members involve others in the planting 
process? 

* 

How do the different councils/committee work 
together i&designirtg , implementing/ and moni- 
toring the planned program? 



In 



what ways* has 
council/ committees? 

How effective *_.4° 
believe they have 
responsibilities? 



Che district supported the 



council /committee members 
beten in fulfilling * their 



How , effective do the parents and staff members 
believe the council/committee, have been? 



1 



L . 

Verifying sources of Inrormatidn : 
observation/documents 
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CPflORTUaTIES for d*toving jhe socol site cgunqc/ - 

SCHOOL ADVISORY COUNCIL/BILINGUAL ADVISORY COMITTEE 

* 

The stetewnts listed below indicate actions tfiich may hive been or staff, and others at the school. Th* SSC/SAC/BAC, along with other 

need to be t#cen to improve the effectiveness of your program. The staff and parents, should review these suggestions, determine their 

specific opportunities selected by the reviewers reflect their potential effectiveness* for progrmn .Improvement, and then decide how 

understanding of your program and their best suggestions for what your your ongoing planning, translating, and evaluation procedures will be 

next steps mijfit be to make yotr program more effective for stud&nts^j{ used to incorporate them into your progran. 

Selected* Opportunities for Improvino 

a. Provi* in-service training, so that each mentor undent ends: 

- The purpose of the SSC/SAC/fifr^nd his or her responsibilities < v ^ * 

as a mentor. * \ 

i \ 
„ - How to carry out his or her responsibilities for planning the 
program. 

- How to work with other comclls/comdttees. , 

- The purpose and requirement? of eact) of the special funding \ 

sources received by the school throu#> the consolidated J ^ 

application y 

b. Verify that individual SSC/5AC/BAC mentors are thoroughly fanlliar 
with the school plan, including services for students with special 

needs, the budget, and the planned day-to-day operation of the * 
program. 

c. Est*>lish or extend. ccnwv>ication 'and collaboration among the 
various cocncils/conwittee (including the Xomnlty Advisory 
Cornell). 



d. Involve parents and staff masters who are not mentors of the 
cookIKs; in the work of the poup(s). 

e. Involve each men to r in determining how the SSC/5AC/BAC functions. 

C. Ensure,thet agendas and activities reflect the concerns of the 
school tcomeuuty 

g. Pnwide services to seaport attendance of mentors and guests ?uch 
as: 

- Sctodullng of meeting times to aoccmmocfete the personal J 
schedules of parents snd staff 

- Translation services for limited- or non-English speJclng 
» parents. % 

h. Solicit CAC advice on issues related to special education. 
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THE EFFECT OF THE IMPROVEMENT PROCESS: PLANNING , TRANSLATING THE. PLANNED PROGRAM INTO ACTION tiff EVALUATION . 



\ 



" This criterion focuses on how effective the 
planning, translating, and evaluation procedures used 
v by the staf t and parents at the school have been in 
developing aM maintaining' a program responsive to the 
student and program needs. 

In judging the effects of planning, translating 
.the ,plln into action, ancV eval\iation, use evijlehce 
collected while reviewing the plan, the Instructional 
program, " and support services. In gathering 

information about planning and evaluation, consider the 
school plsn, the process of planning and evaluation 
that led to the development of the plan, and the 
ongoing planning apd evaluation activities. 

The structure of the school's ongoing planning and 
evaluation process, 4j not as critical as the 
effectiveness of the process, its impact on .the 
learning of Students, and the Involvement of personnel 
at the school site. „ 

The process may be formal , informal , or both. It 
i may Involve 'component committees, tot 41 staff, or 
representative groups, of the councils as the f 6 mm for 
decision making. Whatever Jt he form, the process should 
^include the following ifc order to attain maximum 
Effect: v 4*y*% > 

• Underst*ndli^by .all perjonnel of the con sol 1- 

• dated program purposes and requirements 

• Agreement on goaH^and expectations 



• Agreement on the program designed to reach goals 
ami expectations 

• Understanding of .rples and responsibilities 

l'91 • '■ 



•'Allocation of resources need to translate the 
plan Into action ^ % 

• AnJmgoing .planning process 

• An evaluation design 

• Use of evaluation information for modification 
anil refinement of the program 



) 



Once a plan Is written, the cycle of translating 
the" pian into action, ongoing planning and evaluation 
begins, moving to replannlng, to modification, and 
again to translating the modification Into action. It 
Is a - continuous, year-round "process involving all 
personnel concerned with the instruction of students. 

Translation activities should Involve Everyone 
Included In the planned program. Talk to staff, members 
about how they communicate with e?ch other; how they 
work together; the kinds of support they receive from 
each other,' the administrators At the school, the 
district office; how they know What they are to do In 
carrying out their part of the planned program; and so 
forth. Talk to the principal .and other administrators 
about how assignments are made , ^ roles are defined, 
translation activities are supported, tfie 
implementation of the planned program Is monitored, 
decisions are made, and problems ' are solved* am) so 
forth. 



The reviewer moves back and forth between the 
planned program and the implemented program in Qrd^r to, 
understand Interrelationships between planning ana 
translate the plan into action; that is, what people 
have done, are doing, and**WllI do, the make the plan 
become a reality. ) * 
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CRITERIA FOR JUOGING QUALITY 
THE ffTECT CF PLAWING, TR/WSLATING T* PLAN INTO ACTION, AND EVALUATION 



This criterion focuses on how effective the planning, -transiting 
evaluation procedures used by the, staff and parents at the sctfooU have 
tten in developing *id maintaining a< program responsive ta,st)frdent and 
* program needs. v ■ 



Apply this criterion to Judge the quality of the Improvwient prows In 
terns of the effect of planning, translating, and evaluation activities 
the planned program. 



The planning,- translating, *nd evaluation 
procedures used by 'each council or committee 
and other staff anfl^ parents at the school are 
Wlear or little is known iba^jjgem. There 
Is little eyeement on goals* and expectations 
for students pr on what the school program 
should accomplish and how. Few of those 
involved in carrying out the plan can describe 
, how their- roles and Responsibilities fit Into 
s tnV > planned^ progr*n, nor . <$q : the daily 
^most of the staff and parents 
yinp, out the planned program. 
cgm*/>icatioo f coordination 
improving the school program 
durfcs for onjo^j planning 
*ve not been defirld and there 
:ion among parents and staff 
developing .such procedures this 
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The pluming, translating and evaluation 
proc^dur^s used by the cax>cil/ccmmittee mem- 
bers have led to general agreement among the 
ccxncil/ccnnittee members about student and 
program needs and about what should be accom- 
plished and how; other staff and parents 
involved in the progran generally i*xterstand 
what thos* agreements are and are supportive 
of them. Most of the day-t^day 1 activities of 
people at the school area response to the 
planned pfogram. While pRple involved in 
individual areas of the planned program know 
the goalj and expectations for students within 
their areas, and what ttwlr individual respon- 

sibmies'are, oni * sm ° f the P^ 1 * at tn ^ 
school" are well informed abbut the whole range 
of goals, expectations and responsibilities in 
the plan how what they do fits in with 
what others 00. Procedures fqjr ongoing plan- 
ning *xl evaluation are defined but infre- 
quently u*ed. Modification to planned activi- 
ties sometimes occur primarily in response to 
the staff's operational probl** rather than 
in response to observed , effect*, of the 
instructional proojam on'students. 




I I 
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The pluming, translating, and evaluation pro- 
cedures Lped by • the car* il /committee and , 
other staff and parents have led to a.hijji 
level of agreement about student and program . 
needs, *>oUt what should be accomplished and - 
how. Staff -and parents are working together to ; 
implorent the program' as planned and the day- 
to-day activities of the people at the school 
are tt&se, envisioned in the planned program. 
Everyone involved in darrying out the progM* 
understands the overall intent of the jrogram 
improvement efforts, what their individual 
roles and responsibilities are, what must be 
done to carry out those responsibilities and 
how their responsibilities relate to what 
"others are doing or will do. (bod communica- 
tion, coordination and mutual support are 
obvious. Ongoing planning and evaluation pro- 
cedures are known to ill involved in th*j pro- 
lan aid routinely used. Modifications of 
plained activities are made io response to the 
observed effects of planned instructional 
activities on students and observed effe<±* of 
support activities on the instructional * 
program. 194 
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,.' GUIDE FOR COLLECTING INFfcRMATION ABOUT PLANNING, TRANSLATING THE ?{kH INTO ACTION 



Area of investigation 

Agreement about the 
planned program 



Understanding roles* and 
responsibilities \ 
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Primary source of information : 
interviews 

How have staff and parentsl been ' involved in 
planning? Who was involved? 

How did the planners inform others about the 
planned program? How did they get others 1 

* Input in planning? How was this input used?* 

How were agreements about the planned program 
reached? How widespread are the agreements? 

What process is used when there is a lack of 
agreement? Are inforaal as well as formal dis- 
cussions of problems or solutions encouraged? 

How well do personnel responsible for planning 
and Implementing the planned program understand 
the purposes and* requirements of the Consoli- 
dated Application/SESR programs at the school? 

What .in-service training for planning and eval- 
uation was provided ttfe staff and the C9uncil/ 
committee? 

How are responsibilities for the various* parts 
of the planned program determined? 

How well do people understand their own roles 
and responsibilities? Do they understand the 

* roles and responsibilities of others? - 

How, well do triey understand how their activi- 
ties and responsibilities relate to what others 
do? 

How 'have etal^f been prepared to learn, under- 
stand, and acc*pt the roles and responsibili- 
ties of their Jobs? t 

11-82 



Verifying sourqes of information: 
obse rva t ion/ documents 



bservatioit: Is there an atmosphere 



of communication and collaboration 
among staff at the school? Do 
personnel appear to understand and 



to the planned 



have commitment 
program? 

* 

Documents ; • Council/committee 
agendas and minutes; staff meeting- 
records; interstaff communications; 
district communication*; SESR 
records and r communication home/ 
school cowounciation. t 



Observation : Are the rolefc defined 
in the plan being carried out by 
the personnel asigned? Do people 
knoK what they are supposed to do? 
With^tmom? 

Documents : Any records of planning, 
translating, and evaluation activi- 
ties including memos, and other 
coMunlcat ions among staff and 
xounci Is ; lEPs/JLRs ^ the school 
plan, standarited and other test 
data; survey data; interstaff 
communications.' ■ % 
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Area of investigation 

Ongoing planning and 
evaluation procedures 



Primary source of information; 
interviews 

# 

What ongoing planning procedures^ formal and/or 
informal), are used to make program modifica- 
tions? Who , is responsible for what? Does the 
process work? *Is -there commitment to thte 
process? , * 

• » 
Wh$t is the ongoing planning process by which 
the local school personnel v contribute to the 
revision/modification of the SESR plan? x 

What types of evaluation information ^pre 
gathered? How frequently? Who is involved? 

How are evaluation data used in planning for 
program change? 

How '"do staff atjd others know whether or hot 
what they have* planned 1 and implemented is 
making a difference In student learning? 

What personnel are involved* in planning and 
evaluati6n activities conducted ichoolwide? * 

What are the procedures for identifying and 
solving a problem in translating the plan i/its 
action? Who Is involved? • 

How does the problem solving proceas relate to 
the ongoing plann^np and' evalurftioff. process at 
* the school? * • ~ - 



Verifying sources of information: 
observe t lop/document s 
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OPPORTUNITIES FO| IMPROVING PLYING, TRANSLATING THE PLAN INTO ACTION, ^DEVALUATION 



The statements listed below indicate actions which may have been or 
need to be taken to improve the effectiveness of yo\jr program. The 
specific opportunities selected £y the reviewer* reflect their 
understanding of your program and their^best suggestions for what your 
next steps mic^it be to make your program more effective for students, 



a. Allocate time and resources for planning, translating, .evaluation 
activities. 

b. Identify individuals to provide specific, leadership in .planning and 
for ongoing planning and evaluation, 

c. Clarify who is resppnsjble for wh^t, and hew the various roles 
slat 



l 



are- related to each other, . 
d. Establish effective communication and coordination procedure^, 
e 



Provide staff development so that eacfi adult working in the "program, 
including those providing services for students with special needs, 
understands:* 

* - The intended impact of the planned program on staff and students 

- His or % h*r own individual role ahd responsibility in carrying 
out the specific activities, of theplart and rpw and with whom to 
work in carrying out the specific activities of the planned 

t program - 

- How newly planned activities fit with existing program activities 

f. Est*>lish a process for rfldnitorino the implementation of the planned 
program, including services fortfstutfents with special needs. 

g. Est*)lish a decision-making process for making program^ moclificat ions 
which provides for: 

- Using evaluation results to confirm previous agreements or < 
determining the need* for change j 

- Developing alternative procedures and selecting among those 
alternatives 9 

- Implementing selected procedures 

h. Ensyre that the S9C/SAC/BAC are central to the decision-m*kiVig 
process* * 



staff, and others at the school. The SSC/SAC/BAC, along, with other 
staff 4 and parents, should review these * suggestions; determine their 
potential' effectiveness for program improvement, and then decide how 
.your ongoing planning, translating, and evaluation procedures will be 
used to incorporate them into your program. 

./ r * 

Selected Opportunities for Improving , 
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CHAPTER II t ! 
PROGRAM REVIEW FINDINGS 



This chapter Includes a description of the report 
of program review findings and how these findings are 
shared with the schogl community. The development and 
presentation of the final report Is also 'described. 
While parts of this chapter will be useful to schools 
conducting 4 internal or fcelf .-reviews , the chapter is, 
intended primarily for reviewers who are conducting an 
external review. % \ 



What The final Report Includes . 



The final report is both a written and an oral 
report delivered at the. conclusion of a program review. 
It is. the means through which the findings 6f the review 
^eam, together with the reviewers 1 suggestions for how 
the school program might be improved , are shared with 
the staff, school councils, district re pfesent arrives, 
and other parents aqd community members at the school. 
It is the moat critical element of the entire review 
process • 

The* purpose of the final report is to provide for 
those at the school a reflection of the current 
effectiveness of the school program and clear sugges- 
tions for ways in which the effectiveness of the program 
'can be sustained and/or increased. • A successful final 
report not only confirms and extends the knowledge that 
staff and parents have about , their program, but v also 



yields suggestions about how the improvement process at 
the school (!•$•, ongoing planning and evaluation 
activities and activities used to translate the ^planned 
program into "action) can be used to make the program as 
effective a* 4t was Intended to be. A successful final 
report is a stimulus for continuing program improvement. 



TWo forms are used for the final report: the quality 
criteria and opportunities for improving are included In 
Chapter II of this handbook; the compliance criteria are 
published separately. Both report forms are Organised 
according to the model^ of a school program described 
earlier (*pe Chapter I). The forms Include a section for 
each concentric ring within the model of "a school 
program: 4 * 

\ » 

• instruction f 

• Instructional Support 

• The Improvement Process 

Within each of the sections 9 the quality report form 
is organized in^O two types (of review findings: <<1) 
quality or effectiveness; and (2) opportunities for 
improving. * 
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How thg Report Is Developed 

Preparation for the final report is concurrent with 
ttye process of program .review, for the report is based 
on all the information the team has gathered through the m 
investigatory metnods of observation, interview^ and 
document review. ' .^Information is. tested, verified, 
analyzed, x synthesized, judged, and reported via tW • 
quality criteria and the opportunities for improving of X 
the quality Veport form., \ 

Using the process described in Chapter II of thi^ 
handbook, reviewers gather information during each daV 
of review, and during efcch day confer together to share^ 
what has been learned, to test' the validity of what has^ 
been observed, to plan ways to verify information that 
is not yet certain, to plan how to gather needed 
information, and to identify possible opportunities tfor 
improving the program. During these, conferences 
reviewers measure the informatloif they have gathered 
against that required to make a judgment aboi 
quality of * the .program and opportunities for* improving 
each progrjp area being reviewed 

During these conferences, reviewers will: 

Identify areas that require more information, and plan 
strategies to collect it the next .day (e.g., who will 
• • re torn Ut- particular o^assrojom to gather additional 
* information or who will ask a particular person 
certain questions). • / 
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• Defctelop tentative judgments about^ftrogram quality, and 
. identify possible opportunities >f6f Improvement. 

Identify additional fevidfefte needed to verify theae 

-judgments'. * , 

• Identify and e)fjree on each reviewer 9 9 responsibilities 
for the next day. ? 

Prior to the final report >, on' the ls»t d*y of the 
review, the reviewers will: ^, 

• Review the school plan and all information gathered- 
during the yi slt. * * 

• Compare information collected *^nd reach agreement on 

judgments for each quality criterion. > r 

> ^ • sk- 

• Identify for each area of the review the most promi|^|g 
next- steps for the school to take. 

• Prepare to explain wliy each criterion was so Judged and 
wHy the identified opportunities were .selected . 

• Write the opportunities for Improvement in terms of the 
' school's owri improvement process stating each oppor- 
tunity so that It can startd on its oVn and be under- . 
standable to a reader who was not present at the final, 
report. 

Decide on the order of the presentation and the 
jesponaibllity each^rjevlewer will take .16 presenting 
the review findings, 
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How the Review Findings Are Presented 



ft/di 



Although the review findings are presented as the 
final event of the review, preparations for that final 
event begin during the first review day when the 
reviewers discuss with the principal:" 

e Where the report ' it to be given and when; how many 
people are expected; and how the room is to £e 
arranged • 

• How copies of the quality criteria can be made 
available for those in attendance. 

• What special equipment sight be needed (e.g., overhead 
projector, chalkboard,) 

The report itself is presented in two sessions on 
the afternoon of the last day of the review-first, to 
the school principal and whomever he or she selects to 
be present at the preliminary report and then to the 
school community at the final report. 

The purpose of the meeting with the principal is to 
•hare findings and to clarify any questions or concerns 
the principal may have about those findings; It is 
important to jnote tare that if discussion has been 
ongoing between reviewers and the principal And others 
at the school, the findings will come as no surprise. 



In presenting the final rfcport' to the .as 
school community, reviewers begin the report, by) 



e Recognizing that some people in the audience may -not 

have participated in the review and that many have * gfr .. 
participated in only one part of the review,, 
restating who the review team members are, why they^jt** 
there, and 'the purpose pf the review. ^ 

e Emphasising \hat the review is of the whole planned 

program, not of Individual classrooms or. particular * ^ 
pmrts of the planned program and that compliance with v 
laws and regulations Is part of the review. * 

» r *ft 

e Explaining how the quality criteria and opportunities 
are used and how they relate to each .other. 

* - * 

» Recognizing the effort expended by staff and others in 

implementing the planned program and/or their efforts * * 
at improving theit program. . , % 

• ** 
In presenting the findings to the school community the 

reviewers will*: 



e If there are no compliance exceptions, report so 
~ at the beginning of the session. 
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• If there ere compliance- except ions* brief ly discuss 

• eich exception, stating what about the program is 
out of compliance and T#h*t should be done to bring # it 
into compliance. ^ fc 

• Describe the evidence the reviewers found for each 
area of review and rebate that evidence to the 
descriptive paragraphs of the criterion. The. descrip- 
tive paragraphs way be Illustrated by .a transparency 
for overhead projection or by reading or paraphrasing 
from tKe criterion the sentences of the descriptive 

' paragraphs that are appropriate for that particular 
school. 



m>1. S 
ijftt the 



• Preset the quality rating. 

♦Identify opportunities *f or improving the program. 
Expand on the written etstements by sharing Ideas or 
rec(wend#tions on how the school staff and parents 
can use the planning/evaluation process to improve the 
program. 

• Repeat this procedure for each program quality 
criterion „ 

.* 

a Open the report to questions and matters requiring 
clarificdUon J 

NOTE: 1 Findings are not negotiable. If the school 
personnel believe that the finding on a specific Item 
does not accurately reflect the program, they may give 
additional information on that ite^ after the Report ie 
completed. The reviewers may find It necessary** to 
request documentation or other validation .of that 
Information following th^completion of the report.^ The 
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reviewers will decide In private whether the additional 
Information is new to them or whether It haa Already been 
considered. If it is new Information, they may use It to 
review the accuracy or completeness of the judgment In 
question. % 

r 

The'repor^ Is concluded tfy the reviewers; 

• Thanting the school community for its hospitality 

^.e Completing the review paperwork 

Fol low-Up to a Program Review 

While the Department 'of Education has no standard 
1 procedure for "followli^ up on the quality findings, 
compliance exceptions are monitored by the Department. A 
school with compliance exceptiona has 45 days In which to 
respond with a solution^ to the problem 05, if the problem 
is oAe which cannot be. resolved within that time frame, 
to enter in a compliance agreement with the Department, 
' stating how the problem ulll be reeolved and when. For 
follow-up assistance^ In implementing the recommendations 
or suggestions for* program improvement/ the school 
personnel, should contact their district resources, their 
county office, the State Department of' Education, private 
or public Institutions, staff development .centers within 
their area, or whatever they decide would be best for 
them. While external, ' agenciea slwuld be aware that 
ichools that hive experienced an analysis of the 
effectiveness of their program—whether Internal or 
extern*l--are ,.\moet receptive to progrsm imptovement 
suggestions, the decisions about- who should help in 
implementing recommendations or modifying the planned 
program rests with thf. school and district. oAO 
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